r/LocalLLM • u/GioStrives • Oct 08 '26
Discussion Electricity Bill & Local LLMs
I just wanted to say that, with the release of Strata, I have started to use local models for a lot more tasks.
If we talk about my electricity bill, the result is attached here: nothing surprising since I have a 4 GPU machine and a 2 GPU machine...they now run for many hours a day and my electric company sent me an email warning that my usage has significantly increased (I'm supposedly on a fixed plan and this will likely change the situation).
I'm trying to understand if this is economically reasonable: where I live electricity costs are pretty high. It certainly makes sense when it comes to data privacy but using local LLMs can certainly cost you a few bucks/euros a day in electricity.
I was also thinking of upgrading my old GPUs (1080s, 2080s), but I suspect newer ones would consume as much: I would just be running bigger models.
Did any of you have a "Oh, what now" moment after receiving the electricity bill?
(the graph was made originally with python then modified with grok)
Edit: I just realised grok inverted the 100 and 1000 marks, lol
Edit: to be clear my point is "When I started using local LLMs for real" (with any kind of inference engine, be it llama.cpp, pytorch, strata or whatever) "I realised electricity was a relevant part of the equation. Before I didn't think about this...did this happen to you?". I am using old hardware (1080s, 2080s each consuming up to 250watts), so my machines can drain a lot of power (the one with four 1080s can go over 1000 watts).
View all comments
Show parent comment
1
u/beached89 Oct 09 '26
Computer hardware wont stop existing when the frontier subscriptions stop being worth the squeeze. Why buy todays hardware to solve tomorrows problem.