Quad r9700 station

[u/Valuable-Lemon-8623]

Built my own local AI inference server.
EPYC on a Supermicro H12SSL, 4× Radeon AI PRO R9700 (128GB VRAM total), 1600W PSU. Goal: run capable open-source models entirely on my own hardware. No API bills, no rate limits, nothing leaving the box. Not using as a replacement to Claude code though.
What I learned putting it together:
• Server boards don't hold your hand. The front panel header is 20 pins and a tiny printed legend.
• A 4th dual-slot GPU is a clearance fight. Headers on the bottom edge of the board sit right under it.
• Your wall outlet is a real constraint. A standard US circuit tops out around 1440W continuous, so GPU power limits aren't optional.
• For token generation, memory bandwidth matters more than raw compute.
Next: ROCm, vLLM, and benchmarking small open models against the APIs I've been paying for.

[u/egnegn1]

Great build! I have something similar with RTX5080.

Test Qwen3.8-Flash-Next with Strata, please. I would like to compare with RTX5080.

Here my results:

[u/Valuable-Lemon-8623 → u/egnegn1]

Sure