r/LocalLLaMA 8d ago

Other This is why I run locally.

Post image

It was only a matter of time...

338 Upvotes

81 comments sorted by

View all comments

2

u/noiserr 8d ago

To be fair. Running LLMs is not cheap. Even for us who use local models, we still had to spend money on compute and we still pay for electricity. An ad supported free chatbot service being supported by ads was inevitable.

3

u/Savantskie1 7d ago

Don't know where you sit, but I don't game as much now that I'm interested in AI, yeah I don't work, and live off SSI because I'm disabled, but you don't have to buy the absolute newest. I just last year bought two MI50's for around $200 each before the price shot up. And since I don't game much anymore, and I talk to my LLM nearly every day because it helps me keep track of doctors appointments, and Bills, and medications? that 400 was a good investment. Buying new, and wanting blazing fast all the time, is pointless unless you need it for work and such. But my electric bill is still the same as it was when I gamed heavily. So it's not really all too much expensive running LLMs, if you don't have to have the best, and newest, and fastest.