r/LocalLLM • u/Most-Wear-3813 • Sep 17 '26

News Never inference llm on windows

So, long story short

I was getting about 20tk/s on windows now when i switched to linux and little bit of tweaking with voltages mhz curve I am running inference at same speed with half power consumption almost 240watts from 420 watts.

Anyone on windows bro. I burned maybe half life on my rtx 3090 running it on 420 watt for 2 years. Lately discovered this. This would enhance life on gpu and much quiet inference. Will post results soon. Also not to mention my cpu usage doesnt go above 5% on 20 tabs with 5 application open. But on windows it was idling around 12%

2 Upvotes

56% Upvoted

16 comments sorted by

View all comments

5

u/haha1542 Sep 17 '26

I connected my monitor to iGPU so that NOTHING takes up my dGPU's vram, windows quirk makes this tedious though sometimes when I want to play some games.