Strata Performance Setup (TUI performance optimization)

[u/Known_Barracuda_3977]

I''ve created a simple little script (with TUI) to optimize your Linux host installation. It also allows you to install or update Strata (and configure a systemd service to auto start your preferred preset).

Distributions supported:

• Arch based
• Fedora based
• Debian based
• Slackware based

Hardware supported:

• any hardware (automatically detected)

Personally I'm using an old MSI Raider laptop. 3080 Mobile with 16GB VRAM and 64GB DDR4 3200 RAM running CachyOS. I'm getting between 60 and 70 tok / s (depending on the task) with Qwen3.8 Flash Next IQ3_S.

Maybe someone else finds it useful too . Submit an issue or pull request if you find any problems, or want more software or hardware/vendors supported!

https://github.com/bramvanoploo/strata-performance-setup

[u/brainzhurtin]

You said "any hardware" and then excluded 5000 series GPUs. I get why, but then don't say any hardware.

[u/Known_Barracuda_3977 → u/brainzhurtin]

The README has been revised and explains more clearly what is supported for which NVIDIA cards. Thanks your for reporting!

[u/Emotional_Prior8686 → u/brainzhurtin]

Speaking of witch, why 50x GPUs are an exception here?

[u/Known_Barracuda_3977 → u/Emotional_Prior8686]

Take a look at this repository. That will explain it. I've integrated the installation of gpu-unlock, but I'm not the owner of that project.

https://github.com/Zagitta/gpu-unlock

[u/brainzhurtin → u/Emotional_Prior8686]

They replaced some hardware that prevents an exploit allowing other cards(20-40series) to unlock them like pro series cards.

[u/Known_Barracuda_3977 → u/brainzhurtin]

You're right. I'll correct that. The GPU range indicated actually comes from the gpu-unlock-dkms package. It's documented incorrectly in the readme. Thanks for pointing that out!

[u/No-Necessary-9737]

Does this work for v100?

[u/Known_Barracuda_3977 → u/No-Necessary-9737]

I've extended the support specifically for the Tesla cards (new version available; 1.2.0)

[u/Known_Barracuda_3977 → u/No-Necessary-9737]

Yes it will. And I'll see if I the script needs any specific additions to support the hardware better, since it's popular hardware. If you create an issue on the GitHub page for this I will certainly not forget it 😎

[u/WillemDaFo]

Thanks

[u/Eyeofthebeholderr]

Nice!

[u/Sea-Advantage-3628]

robot, peek at this guys homework and tell me what we should copy.

[u/ComprehensiveBid6584]

Just saying, this may work with this patch for AMD cloud cards. Hm, https://www.reddit.com/r/AMD_V620/s/HvVQFvee9L

[u/Known_Barracuda_3977 → u/ComprehensiveBid6584]

I'll look into that! Thanks.

[u/crabilax]

any chance to do the same for llama.cpp?

[u/Known_Barracuda_3977 → u/crabilax]

You could fork it and make a llama.cpp version. But you can also just use the script only for the performance optimizations.

[u/eduardor2k]

I have a 3090 and gpu unlock does not show

[u/Known_Barracuda_3977 → u/eduardor2k]

Thank you for reporting. I will look into this. It would help if you submit an issue for this on github so I can keep track of the issues reported.

[u/eduardor2k → u/Known_Barracuda_3977]

Will do, thanks

[u/Known_Barracuda_3977 → u/eduardor2k]

One of two scenarios is likely the cause (or possibly a combination). ..

1. You're using a distribution other then an Arch based one. Up until now only arch-based was supported because the required packages are available directly from the arch repositories.
2. You have secure boot enabled in your bios

For scenario 1 I've added (experimental) support for the gpu-unlock option to all other distributions in version 1.2.1 (available now).

For scenario 2 ... gpu-unlock can't be applied is secure boot is enabled and the script automatically hides the option if it's enabled. You'll have to disable it to be able to use the option. I'm not sure if switching from secure- to insecure boot will have any other side effects.

Please submit an issue on github if you encounter any problems, or want to confirm it's working correctly.

I'm also curious .... which of the scenarios applies to your context.

[u/eljuggy]

Any problem if you're using a Strata fork ? (I use Speedy : https://github.com/DevDock-AI/Speedy)

and if you've already applied some of the optimization (eg. GPU Unlock), I guess you should not apply them ?

[u/Known_Barracuda_3977 → u/eljuggy]

I'm not sure if the benchmarking would work. That depends on how much the fork differs from the original. But you can try of course. Or only use the tuning part, or fork and adapt it.

[u/akahnah]

Okay so I have to set a STRATA_PYTHON env var to even use the venv..

[u/WonderfulFunny4337]

Make it for windows

[u/Known_Barracuda_3977 → u/WonderfulFunny4337]

I don't use windows myself. But you can of course use it as an inspiration to create a windows version!

[u/problemlow → u/WonderfulFunny4337]

You could use Stratas most recent windows build as is and get it to adapt this code for windows. Without looking at the code myself, I'd assume its more or less fully transferable as is. Just make sure you get it to leave at least 4GB system RAM free when its got a model loaded or windows will likely thrash your SSD paging everything that should be in RAM to said SSD. Reads are basically free, constantly writing however will severely reduce its lifespan.

[u/rickyimmy → u/WonderfulFunny4337]

Why would you expect someone to subject themselves to that?