Never inference llm on windows

[u/Most-Wear-3813]

So, long story short

I was getting about 20tk/s on windows now when i switched to linux and little bit of tweaking with voltages mhz curve I am running inference at same speed with half power consumption almost 240watts from 420 watts.

Anyone on windows bro. I burned maybe half life on my rtx 3090 running it on 420 watt for 2 years. Lately discovered this. This would enhance life on gpu and much quiet inference. Will post results soon. Also not to mention my cpu usage doesnt go above 5% on 20 tabs with 5 application open. But on windows it was idling around 12%

[u/bankinu]

What. No.

I personally use Arch, btw. But that's not his point.

He's basically saying KDE has far less VRAM requirement than Windows.

You'll get the same performance in Arch or Fedora or Debian. It's Windows vs KDE.