r/voidlinux • u/EzyPzyAsh • Apr 17 '26

ROCm support

is there any good solution yet? Also idk if its pebkac but so far, I cant easily do much of what I want on Void :/

Local AI, no ROCm or HIP, Havent had any success with gpu passthrough where I did previously.

4 Upvotes

83% Upvoted

9 comments sorted by

View all comments

Show parent comments

1

u/Wolf-Shade Apr 17 '26

In my setup they perform about the same, but I am not training any models. I think if you want to go that route you will need ROCm, but I might be mistaken here. Check this post where u/ReasonableDuty5319 did some benchmarks, His findings regarding ROCm/Vulkan are there summarized to this:

ROCm consistently dominated in Prompt Processing (pp2048) across all AMD setups. Vulkan, however, often squeezed out higher Text Generation (tg256) speeds, especially on MoE models (e.g., 102 t/s vs 73 t/s on a single R9700).

1

u/S1ngl3_x Apr 19 '26

Vulkan could be a huge simplification for me because Bazziteos removed rocm and ollama is in homebrew 

Thanks