The worst people live forever. See: Kissinger.

You can look at the stats on how much of the model fits in vram. The lower the percentage the slower it goes although I imagine that’s not the only constraint. Some models probably are faster than others regardless, but I really have not done a lot of experimenting. Too slow on my card to really even compare output quality across models. Once I have 2k tokens in context, even a 7B model is a token every second or more. I have about the slowest card that ollama even says you says use. I think there is one worse card.

ETA: I’m pulling the 14B Abliterated model now for testing. I haven’t had good luck running a model this big before, but I’ll let you know how it goes.

AI isn’t the enemy, though, and we aren’t the ones being grifted—that would be companies who think they can make tons of money replacing people with AI. It’s a reasonable useful tool/fun toy/interesting curiosity in certain circumstances. And for an end user it doesn’t use any more power than a video game. But it’s a tool for craftsmen and folks who understand the limitations, not a replacement for workers. And it sure as hell isn’t a production feature. Anyone looking to make money baking AI into consumer products is an idiot and going to lose their hat.

That’s not the monster model, though. But yes, I run AI locally (barely on my 1660). What I can run locally is pretty decent in limited ways, but I want to see the o1 competitor.

Cheaper AI isn’t the pop we want. We want companies to stop trying to use AI for every god damn thing it is terrible at. We don’t want cheaper AI that’s just going to be baked into more stuff.

deleted by creator

I went to go install it this morning to check it out, but I had to decline when I read the privacy policy. I might check it out on my desktop where I have a lot more tools to ensure my anonymity, but I’m not installing it on my phone. There is not one scrap of data you generate that they aren’t going to hoover up, combine with data they get from anyone who will sell it to them, and then turn around and resell it.

I’m sure other apps are just as egregious, which is one reason I’ve been deliberately moving away from native apps to WPAs. Yes, everything you can possibly do on the internet is a travesty for privacy, but I’m not going to be on the leading edge of giving myself to be sold.

Mangione has been charged with first-degree murder “in furtherance of terrorism,” which may clarify things for platforms about whether to consider him as a single accused murderer or an alleged terrorist when it comes to content policy.

Convict him of that shit first, otherwise you’re just allowing the government to dictate moderation policies. He’s only being charged with terrorism so the state can murder him. I’m not saying anti-terror policies are bad in general, but this is abuse of the system.

You mean like we’ve suddenly achieved lower denial rates or single-payer healthcare? Nothing so grand, but people are talking and both sides of the political spectrum have found a semblance of unity over this—which is probably the biggest thing they don’t want to see, is people taking their eyes off the culture war and noticing the class war.

I’m with you there.

I think this is about as likely as other conspiracy theories: not at all.

We’re going to find out that he’s just a guy. Which is disheartening when we imagine someone coming along and saving us and setting right all the wrongs.

But also he’s just a guy. I’m not saying killing is the way forward, but he inspires the belief that we can change the world ourselves. We don’t just live in a world controlled by the rich or shadowy conspiracies; we live in a world where we can have an impact.

What??? But… I posted a disclaimer and license! How can they slap???

I mean… it’s a lot of money. Every day I had to put up with some bullshit—that’s most days—I’d be grumbling to myself about that fortune I’d have if only…

Why the fuck can’t we make things hot without the internet? FFS

Fire: “I got you, bro.”