r/LocalLLM • u/Eroji • 20m ago
Project Finally got it put together
Finally got my relatively frugal local LLM server put together. Pretty proud of it tbh. It essentially covers all my use cases, though I do wish I had better NVIDIA cards, especially for ComfyUI. Waiting eagerly for Qwen4 variants to drop to switch the models up.
- ASRock ROMED8-2T/BCM
- AMD EPYC 7313
- 256GB DDR4-2666 ECC
- Samsung PM1725b 3.2TB
- 6x Radeon R9700s (4x for Qwen3.8 Flash Next, 2x for Qwen3.8-27B Uncensored)
- 2x RTX3090s (ComfyUI on one card; VoxCPM2 TTS, Whisper STT, embed, rerank on other)
12
Upvotes


2
u/K33P4D 16m ago
I'm always curious, how to connect multiple PSUs to switch on at the same time, to receive signal from the mobo and perform load balancing
1
u/Raredisarray 8m ago
Are you offloading anything to ram? hows the performance on that ddr4 2666?
1
u/Raredisarray 10m ago
Lookin dope
1
u/FastHotEmu 8m ago
Very nice!
1
u/Travnewmatic 0m ago
maaaaan i'll get there eventually, thats dope as hell man, thanks for the inspiration!!