General Kenobi
(I can’t help)
Just a guy shilling for gun ownership, tech privacy, and trans rights.
I’m open for chats on mastodon https://hachyderm.io/
my blog: thinkstoomuch.net
My email: [email protected]
Always looking for penpals!
General Kenobi
(I can’t help)
For simply productivity like Copilot or Text Gen like ChatGPT.
It absolutely is doable on a local GPU.
Source: I do it.
Sure I can’t do auto running simulations to find new drugs and protein sequencing or whatever. But it helps me code. It helps me digest software manuals. That’s honestly all I want
Also, massive compute projects for the @home project are good?
Local LLMs runs fine on a 5 year old GPU, a 3060 12 gig. I am getting performance on par with cloud ran models. I’m upgrading to a 5060ti just because I wanted to play with image Gen.
Whack. I just set up a Forgejo too.
Which is funny since that does solve a lot of the problems.
If it’s completely open source at least.
Like OS data sets and model that can be ran locally means it’s not trained on stolen data and it’s not spying on people for more data.
And if it runs locally on a GPU, it’s no worse for the environment than gaming. Really the big problem with the data center compute is the infrastructure of getting that data around.
I am a fan of LLMs and what they can do, and as such have a server specifically for running AI models. However, I’ve been reading “Atlas of AI” by Kate Crawford and you’re right. So much of the data that they’re trained on is inherently harmful or was taken without consent. Even in the more ethical data sets it’s probably not great considering the sheer quantity of data needed to make even a simple LLM.
I still like using it for simple code generation (this is just a hobby to me so Vibe coding isn’t a problem in my scenario) and corporate tone policing. And I tell people non stop that it’s worthless outside of these use cases and maybe as a search engine, but I recommend Wikipedia as a better start almost Everytime.
I was honestly impressed with the speed and accuracy I was getting with Deepseek, llama, and Gemma on my 1660ti.
$100 used and it was seconds to get responses.
It’s not a Lemmy thread without some Star Trek references
Robert Beltran (Chakotey), Roxan Dawson (B’Elanna), and Manu Intiravmi (Icheb).
All three of these actors fell off after ST:Voyager and became vile conservative shit posters. I know Robert especially likes to respond to anti Trump or anti Trump Policy tweets the other ex cast members make with “both sides” arguments.
It’s sad in my eyes, but I do hold ST on a pretty high pedestal.
Gotta protect those Video Game movie deals.
Don’t wanna risk that Ganon cast in the Zelda Movie
Despite everything. I was considering giving it a try, just to see.
But your right, if there’s a CSAM community on there I would inevitably host it to.
So I will not be trying plebbit
Homie, you used 4chans logo in your shitty nft drops
https://x.com/getplebbit/status/1516387903177383948
I just assume anything that promises free stuff on Instagram reels is in fact a scam or a hack.
Also I’m not getting on that shit site to confirm it’s true.
Israel has a history of ostracising those they deem “cowards” in society.
Just look into how they remembered the Holocaust and how they treated the survivors.
I both hope those brave soldiers stay in Israel to lead a change and hope they don’t let the state crush them with the gleeful support of the fascist civilian population.
Dunno how big they are. Might be a technical disconnect between the PR person and the devs.
I can excuse a marketing person making this whoopsie, but a dev? Come on you 100% saw the copypasta
Hell, I bet they have stats on exactly how many Linux users they have just based on how many people use proton.
I’m inclined to believe not a single actually suicidal person received one of these messages.
You can’t automate concern for fellow humans.
If there’s anything I’ve learned from my fiance, it’s that there’s both nothing wrong with a piece of media being for younger audiences and theres nothing wrong with consuming stuff meant for younger audiences.
Shit, Prodigy is endlessly shilled by folks on Mastodon with 18+ only in their banners.
This man will repair your car in such a way it will both never break and when you do go to a normal mechanic for something they will gaze upon it in awe and horror.
My avatar is also partially AI generated. I GIMPed the Zizek face from one of his movie posters though.
I’m used to people calling me out for the Zizek part and that hasn’t happened on Lemmy ever lol.
I like a very small amount of RGB.
I didn’t always, I wanted full no color, but the ONLY GPU I could find had just a smidge of RGB in the logo (MSI something 5060 ti) and I like it as a highlight.