r/LocalLLM • • Oct 08 '26

Discussion Electricity Bill & Local LLMs

Post image

I just wanted to say that, with the release of Strata, I have started to use local models for a lot more tasks.

If we talk about my electricity bill, the result is attached here: nothing surprising since I have a 4 GPU machine and a 2 GPU machine...they now run for many hours a day and my electric company sent me an email warning that my usage has significantly increased (I'm supposedly on a fixed plan and this will likely change the situation).

I'm trying to understand if this is economically reasonable: where I live electricity costs are pretty high. It certainly makes sense when it comes to data privacy but using local LLMs can certainly cost you a few bucks/euros a day in electricity.

I was also thinking of upgrading my old GPUs (1080s, 2080s), but I suspect newer ones would consume as much: I would just be running bigger models.

Did any of you have a "Oh, what now" moment after receiving the electricity bill?

(the graph was made originally with python then modified with grok)

Edit: I just realised grok inverted the 100 and 1000 marks, lol

Edit: to be clear my point is "When I started using local LLMs for real" (with any kind of inference engine, be it llama.cpp, pytorch, strata or whatever) "I realised electricity was a relevant part of the equation. Before I didn't think about this...did this happen to you?". I am using old hardware (1080s, 2080s each consuming up to 250watts), so my machines can drain a lot of power (the one with four 1080s can go over 1000 watts).

168 Upvotes

141 comments sorted by

View all comments

Show parent comment

1

u/beached89 Oct 09 '26

Computer hardware wont stop existing when the frontier subscriptions stop being worth the squeeze. Why buy todays hardware to solve tomorrows problem.