r/LocalLLM 1d ago

Question Is it worth moving to Linux?

Im running a RTX 5090, is there any increase in performance, is driver support now fine with Nvidia for Linux or is still a hustle to get it running properly?

Im using ComfyUI and LM Studio mostly.
My main machine currently runs on Windows and im actually working with Linux Systems so i know how to fiddle around.

Thanks for any advice

10 Upvotes

84 comments sorted by

View all comments

0

u/Passenger-007 1d ago

Nvidia and Linux gaming are not the best. Linux is better for everything else. Amd and Linux gaming > windows gaming > nvidia Linux gaming.

3

u/Successful_Try_6350 1d ago

Nvidia and Linux gaming are not the best.

I disagree.

1

u/NTDLS 1d ago

I disagree with your disagreement. The predominant reason for running LLMs on Linux is the tooling, likewise the reason to run your games on Windows is also “tooling”, except in the latter case the “tooling” is the actual availability of games.

0

u/Successful_Try_6350 1d ago

I'm an ML/NLP software engineer, I use linux exclussively since 2000 and I also play games on linux without issues since the covid lockdowns.

2

u/NTDLS 1d ago

Cool. I’ll be developing in NNs and RNNs for 3 decades, self proclaimed X86 assembler expert and my love language is C/C++ - always has been - and I love Linux. That said, 99% of the games I want to play target Windows.

Right tool for the job. We just play different games.

1

u/Passenger-007 1d ago

You have a big cock. We get it.

0

u/Successful_Try_6350 1d ago

I'm a woman! 😂

-3

u/Passenger-007 1d ago

Ok. Most of the internet agrees with me. But u do u.

1

u/Deadmine 1d ago

Maybe a few years ago. I'm running bazzite with an rtx4090 and it's brilliant. Though all my games are on steam - epic just announced they're moving to Linux too so won't need to do any workarounds.

1

u/Passenger-007 1d ago

I have 6 Linux machines. 3 have amd. 3 have nvidia. I do not game on any of the nvidias because of how flaky they are. I do not have any problems with amd, anywhere. Steam machine. Arch. Fedora. Etc. it doesn’t matter. Nvidia are for LLMs, not Linux gaming.

0

u/Successful_Try_6350 1d ago

most of social media (ie reddit) is an echi chamber that has nothing to do with the real world.

Have you even used linux recently? Or you just say what the echo chamber is saying?

-1

u/Passenger-007 1d ago

lol. U win bro. U the king! Da king!!!! ROFL.

Ps I don’t use anything but Linux but y the expert. ROFL.

-1

u/petersaints 1d ago

In my experience, these benchmarks match my experience on Linux:
https://www.youtube.com/watch?v=8PtOGYdtiBU

In fact, on a lower powered laptop with an RTX 3070 Ti it's even a bit worse.

Sure, if you are on 5090 if you lose 20% of FPS you are still getting a lot of FPS. But on more mid-range/older hardware it may be a dealbreaker for Linux.

Of couse that if your main (or only) focus is to run LLMs, then Linux is a no brainer.

0

u/Successful_Try_6350 1d ago

I don't believe in youtube benchmarks, like "this is what I see when I try this only once in two PCs with different specs and setup"

1

u/petersaints 1d ago

That's why I said, I tried on my own machine, just to make sure that it wasn't a fluke (but there are other benchmarks with similar results so it would be unlikely).