• 4 Posts
  • 84 Comments
Joined 2 years ago
cake
Cake day: June 4th, 2023

help-circle
  • Yes definitely. Many of my fellow NLP researchers would disagree with those researchers and philosophers (not sure why we should care about the latter’s opinions on LLMs).

    I’m not sure what you’re saying here - do you mean you do or don’t think LLMs are “stochastic parrot”s?

    In any case, the reason I would care about philosophers opinions on LLMs is mostly because LLMs are already making “the masses” think they’re potentially sentient, and or would deserve personhood. What’s more concerning is that the academics that sort of define what thinking even is seem confused by LLMs if you take the “stochastic parrot” POV. This eventually has real world affects - it might take a decade or two, but these things spread.

    I think this is a crazy idea right now, but I also think that going into the future eventually we’ll need to have something like a TNG “Measure of a Man” trial about some AI, and I’d want to get that sort of thing right.



  • I think it’s very clear that this “stochastic parrot” idea is less and less accepted by researchers and philosophers, maybe only in the podcasts I listen to…

    It’s not capable of knowledge in the sense that humans are. All it does is probabilistically predict which sequence of words might best respond to a prompt

    I think we need to be careful thinking we understand what human knowledge is and our understanding of the connotations if the word “sense” there. If you mean GPT4 doesn’t have knowledge like humans have like a car doesn’t have motion like a human does then I think we agree. But if you mean that GPT4 cannot reason and access and present information - that’s just false on the face of just using the tool IMO.

    It’s also untrue that it’s predicting words, it’s using tokens, which are more like concepts than words, so I’d argue already closer to humans. To the extent it is just predicting stuff, it really calls into question the value of most of the school essays it writes so well now…


  • Well, LLMs can and do provide feedback about confidence intervals in colloquial terms. I would think one thing we could do is have some idea of how good the training data is in a given situation - LLMs already seem to know they aren’t up to date and only know stuff to a certain date. I don’t see why this could not be expanded so they’d say something much like many humans would - i.e. I think bla bla but I only know very little about this topic. Or I haven’t actually heard about this topic, my hunch would be bla bla.

    Presumably like it was said, other models with different data might have a stronger sense of certainty if their data covers the topic better, and the multi cycle would be useful there.








  • Never used Chrome, and strongly suggest to other people not to use Chrome. However, I’ve not had the hate for chromium browsers (so far, the killing of extensions might drive me away) - I’ve really enjoyed Vivaldi for a lot more features and having the engine that works on websites (yes this sucks). My mom OTOH is a Firefox person, and I just had to help her get onto her insurance website - she had tech support on the phone, and Firefox just would not let her set a password and just kept looping and using up the reset link. Finally I tried in Vivaldi (Chromium) and it worked first try. Of course, I’ve had the same experience in the opposite direction. So I have to keep using both.

    Also, Vivaldi anyway has a much better UI IMHO for what I want than Firefox does, and is faster. As an IT person, I much prefer semantic versioning which Vivaldi also has.

    Anyway, at this point Chromium is like IE was - you can’t not have access to your health insurance website, and they don’t apparently test in Firefox so it doesn’t work. You can’t drop your provider cause you don’t pick it, your work does. The upshot of Chromium is that there are rebuilds and it runs on other platforms than Windows - so… there’s that at least.

    Honestly, I’d like to see someone fork Chromium and keep web extensions etc, but no one wants to write a browser engine anymore - even Vivaldi, which was the old Opera team that wrote 2 browser engines over the history of the browser through v12 - can’t afford to make their own engine. What I don’t get is why so many browser makers have chosen chromium vs gecko - almost no one wraps gecko in the last 10 years. (Maybe Firefox is different now? I know it in some ways started getting crappy wrt extensions back in v28? whenever Pale Moon forked.)



  • I got work to pay for it. It is pretty good, and I like the lenses function (focus on just forums or other ways to sort). I can’t say that it’s necessarily better in general than startpage.com, which is anonomized google (gets you out of the filter bubble though). I feel like Kagi is very slightly better, maybe 10 percent at most.

    I also don’t love the hard ID they have on you for payment. They claim not to track you but they certainly can, and I’d argue better than Google can if you use startpage.com or whatever anonomized version.



  • The rest of the world isn’t interested in a one-stop-shop for anything and everything.

    I’m not entirely sure this is true. Look at the constant posts and commenting on how people hate to deal with the complication of additional apps / sites. It’s a major negative of the fediverse, it’s one reason I think Signal shot themselves in the foot getting rid of SMS. It’s why people keep using Amazon or Netflix even as they get worse and worse and more expensive. Heck, I’m not even immune - I wish we had one fast and cheap way to transfer money rather than Zelle, Paypal, various bank schemes, venmo and on and on. I wish we had a universal shopping cart thing like Paypal checkout more widely adopted vs making ever more accounts and typing in all my details for a one time order from a different website (and this is one reason why people gravitate to Amazon vs individual sites).

    I’m not saying I’d like an all in one app, but I can see it potentially being interesting to people if it simplified their lives. I don’t think Musk and X are likely to be able to do it, but I don’t actually think there’s no interest.


  • There are tons of Lemmy instances, so figuring out the right one isn’t as straightforward as stumbling upon a single central platform. I’m arguing that it’s exactly as straightforward as picking between Twitter, Reddit, Facebook, Instagram, Pintrest, any website. How did these people who can’t search find reddit? I get that it sucks leaving a company you have a relationship with. I just don’t think it’s hard, and I do think that the last 20ish years (at least) have shown that companies are “take it or leave it”, and rarely if ever respond to requests no matter how you make them. So it’s back to my initial point - you shouldn’t want a “central platform” because eventually it becomes worse and worse. This holds true in theory (monopolies are bad) and practice over recent and longer history.

    I guess I also don’t get the concern about picking “the right lemmy instance” - at worst, it’s like picking an e-mail server, or grocery store. Try a random one, find out what doesn’t work for you (if anything) and then use that knowledge to evaluate the next one. Repeat until happy. In reality - that’s also what we’re doing up a level in terms of platforms in general - I was happy on reddit till I wasn’t. Presumably same for everyone. Many people might still be happy on reddit. I don’t judge that - my beef is if you’re extremely unhappy and yet basically want someone to change reddit for you vs moving on.

    I am NOT at all arguing that it’s not difficult to move entire communities at all. I’m not sure if it’s possible - you’re going to basically fork no matter what. And that sucks, but it’s also something the community risked (and always does risk) on a given platform if it becomes crap for some reason. A community is also never fixed and your reddit community is changing no matter what with the various things going on. I don’t know how big a change it will be for any given community, but to the extent you’re empowered by the central platform, you’re losing some people (those like me) to alternative platforms. You can’t stop that. Heck, even without reddit doing their best to burn their platform trust to the ground, there were always going to be people who move along, try and make a spinoff community either on reddit or elsewhere etc. You can’t have a unified approach unless a large majority agrees to either live with reddit or to leave reddit to the same place. I don’t think either is actually going to happen in the long run.

    And software wise, I think as you have pointed out it seems reddit wants to make things kind of worse and lemmy and the fediverse is trying to make things better. So over time, just like how lemmy is WAY more active now than it was a month ago, I think we’ll see the software improve too. So maybe today it’s really in reddits favor to stay there as a mod - though I know /r/photography didn’t agree - but I feel like each day those lines are getting closer together where you’ll cross and probably end up with 2 viable communities, and one isn’t on reddit and everyone has to choose if they want to be on both, or one or the other. The main thing is lemmy and the fediverse are all in on API access and anyone writing tools, and reddit has closed that off basically entirely. So as I understand it, there’s very little chance to get mod tools back on reddit, but there’s every expectation that people are building mod tools for lemmy. That’s not to say a closed system is inherently bad - but I’ve rarely found it to be the most inexpensive or option filled. I also heard a recent techdirt podcast on distributed moderation and reddit and that all their public competitors have (had? Twitter got rid of theirs but went private) professional trust and safety moderation teams, and there’s a good chance that’s going to be something wanted for an IPO by investors expecting legal or regulatory risk, and with that will be a push for a homogenized set of moderation rules across the entire site. I think that is very plausible, but also will further kill what made reddit special, and if we’re talking about centralized platforms, facebook dwarfs reddits users, and for the “I don’t care about how the site is run” large mass crowd that also does’t care about NSFW niches and such, and DOES care mostly about ease of entry and finding communities - I could see facebook groups eating reddits lunch in the masses, while the others move on to places like lemmy.

    OT slightly: I’ve had multiple interactions on lemmy now where I seem to miss communicate something in a way I didn’t on reddit or in e-mail listserves. And I’m wondering if it’s cultural or ??? Specifically - I tend to quote and comment on the part of a comment I’m replying to that I have something to say about it. The parts I don’t quote I (thought) I was implicitly not arguing with or for and at worst would be neutral to I support because I didn’t “rebut” in my reply. But instead it often seems to be received like you did of me missing nuance. I tried in my initial reply to point out A) this is a rant (so don’t take it that seriously) and I tried to imply B) I’m ranting about this one specific nitpick of the post. Is there some way to do that better? A “signature” I paste in (seems pretentious)? Some formatting change vs quote -> comment / rebut? Thanks.



  • Lemmy (or any fediverse platform) isn’t exactly straightforward to figure out and start participating in. If you can even find the community you are looking for. Reddit also hosts a lot of support communities, who benefit from reddit generally speaking having a low barrier of entry. Many of those wouldn’t be able to be as accessible for the groups they are targeting on other platforms.

    This just feels like a cop out - welcome to the Internet, you need to search to find stuff? Maybe I’m terminally techie, or got online way “to early”, but my god, how did people get on reddit to begin with? It wasn’t a default homepage in a browser. How did they get an e-mail account? How did they find an ISP? Did they need counseling to pick a cell phone provider?

    This feels just like the “Linux isn’t straightforward to …” - Ok? Neither is Android or Windows or MacOS. You just went through that at some point in the past and don’t remember the confusion.

    And it’s not like Reddit started out with those communities. I mean, either you don’t care, or you care and hoping reddit changes is basically like being in an abusive relationship. Maybe try asking a techie friend if you really can’t handle a search engine and reading a small amount.

    I mean, we’re not talking about setting up I2P to access an internal IRC network here, we’re talking about picking a website and getting an account. This should not be hard. And if you’re a mod fleeing reddit, maybe be the change you want to see and start a community on the fediverse.

    I might be not getting something here but it just sounds like “All these people are trapped in a bad situation and I don’t believe they have any agency or ability to learn anything new to get out of it”. These people have agency. Instead of telling everyone “oh Lemmy is too confusing” - point them to the hundreds of posts and websites now explaining how to do it.

    ok… breath… rant over.



  • Indeed, IDK if you remember back in the bad old days but you used to need a specific browser, and if that browser was IE, good luck if you weren’t on Windows. Sites would just block you.

    I really hope this doesn’t become a thing again - it’s already stupid with so many “best on chrome” stuff, but at least I think Apple and Safari put a dent in that because Apple users are a big enough group, and generally identified to have and spend more money than Android / Linux / Windows users so there’s that. And Firefox is… well… something. 10% now? IDK, it’s hard to be single browser now adays, but with these “for security” things? Who knows.

    I guess if Apple, Microsoft and Mozilla all refuse to go this way, it’ll break it. The other option is something like Lets Encrypt being big enough they can’t delist the attester, but it just attest everything so turns into garbage. Or enough accepted attesters (if it’s like SSL PKI) “attest” that you paid them $50 that year and that’s about it, so again, everyone who cares gets a Comodo attestation or whatever and use a browser / extension / proxy / OS / whatever that just sends valid garbage or spoofed stuff to them, like many do for the various existing non-secure identity fields.