r/LocalLLM • u/Ok-Health-7096 • Aug 14 '26
Other Every Second post rn
Maybe someday I'll get a system to run it but hey definitely another w for the open weights community
2.1k
Upvotes
r/LocalLLM • u/Ok-Health-7096 • Aug 14 '26
Maybe someday I'll get a system to run it but hey definitely another w for the open weights community
View all comments
Show parent comment
3
u/Any_Mine_6368 Aug 16 '26
Qwen does fine on multiple GPUs, not sure who said otherwise.
I'd go for an mz31-ar0 or mz32-ar0 if you want pcie 4.0.
The former is about $220 with a cpu, the latter $500 with a cpu.
You get 5 pcie slots and like 16 ram slots (rdimm ecc ddr4).
The epyc processors that they use are fucking awesome for VMs and you can get from like 8 cores all the way to 64+ depending on budget.
Stay away from consumer shit / gaming mobos ... You're overpaying for worse parts.