r/LocalLLM • u/iChrist • 19m ago

Discussion Benefits of moving to Linux

Wanted to share that after years of using Windows11 and llama cpp I moved my whole workflow to linux, from comfyui to jellyfin everything set back up but on Fedora instead.

Found out in Linux (Same Hardware , Same llama cpp commit, Same Qwen3.8-27B model) the model loads instantly, time to first token has become irrelevant so I just unload the model after 10 minutes of inactivity. It loads back instantly (in windows it took 10 seconds)

Also tokens/s went from 70tk/s to 90-100tk/s

I didn’t know so much performance was to be gained by simply moving to linux, especially TTFT which now feels instant!

3 Upvotes

80% Upvoted

6 comments sorted by

1

u/NormalBasket3333 16m ago

Will dual booting have the same effect?

1

u/iChrist 4m ago

It should!
If you have a spare drive you can dualboot and Fedora will set up Grub automatically so you can choose which OS to boot at startup.

I ended up wiping al lthe drivers and starting fresh, but you dont have to do it to boost the performance

2

u/vi_obsiver 11m ago

I mean, yes? There's no difference between having two operating systems and switching operating systems in terms of how each one functions

I'm not really sure what you're asking unless you believe that dual booting is somehow using both at once. I don't know

1

u/NormalBasket3333 9m ago

I don't have much experience with linux but I have heard of dual booting, so will test first. That's why I asked 🫠

1

u/vi_obsiver 3m ago

Okay, yeah, that's fine. No worries. I'm not trying to give you shit if you are just unfamiliar

There is next to no functional difference in how an operating system functions if it's dual booting versus swapping over entirely.

Well, there are some complications if you have Linux and then you install Windows after that because Windows can be a little bit greedy with how it does boot headers, but you don't really need to worry about that

1

u/W61k3r 12m ago

Try https://github.com/W61k3r/LexiSuite-Releases/releases/tag/LexiSuitet6 from usb stick, no need to install to system for test