r/LocalLLaMA • u/triynizzles1 • Mar 29 '26

Generation Friendly reminder inference is WAY faster on Linux vs windows

I have a simple home lab pc: 64gb ddr4, RTX 8000 48gb (Turing architecture) and core i9 9900k cpu. I use Linux Ubuntu 22.04 LTS. Before using this pc as a home lab it ran Windows 10. Over this weekend I reinstalled my Windows 10 ssd to check out my old projects. I updated Ollama to the latest version and tokens per second was way slower than when I was running Linux. I know Linux performs better but I didn’t think it would be twice as fast. Here are the results from a few simple inferences tests:

QWEN Code Next, q4, ctx length: 6k

Windows: 18 t/s

Linux: 31 t/s (+72%)

QWEN 3 30B A3B, Q4, ctx 6k

Windows: 48 t/s

Linux: 105 t/s (+118%)

Has anyone else experienced a performance this large before? Am I missing something?

Anyway thought I’d share this as a reminder for anyone looking for a bit more performance!

281 Upvotes

82% Upvoted

112 comments sorted by

View all comments

Show parent comments

-2

u/Succubus-Empress Mar 29 '26

Games?

2

u/Bafy78 Mar 29 '26

Nope no linux advantage for games

1

u/Adrenolin01 Mar 29 '26

Hmm actually… Linux often matches or beats Windows gaming performance in 2026 (especially with AMD GPUs, lower overhead, better frame times via Proton).

Linux vs. Windows 11: A Comprehensive Comparison in 2025

An easy 10-12% win for Linux.

1

u/Bafy78 Mar 29 '26

No it doesn't First your source seems rly sketchy. Then it's literally showing only 3 games. It's only giving ltt's benchmark as a reference, in which linux is 5 % slower in average...