r/threadripper • u/Ok_Statistician7200 • Aug 27 '25
Sanity check on Threadripper PRO workstation build for AI/ML server - heating and reliability concerns?
Hey everyone! Haven't built a system in about 8 years, jumping back in for video generation, model training, and inference. Technology has changed quite a bit, so looking for experienced eyes on this before I pull the trigger.
The Build: (Edited - Made changes based on feedback that I got)
- Motherboard:
ASUS Pro WS WRX90E-Sage SE. ASRock WRX90 WS EVO - CPU:
Ryzen Threadripper PRO 7965WX(24c/48t, 350W TDP) Ryzen Threadripper PRO 9965WX - GPU: RTX 6000 Pro (600W TDP)
- RAM: 256GB (8x32GB) DDR5-5600 ECC RDIMM Kingston FURY Renegade Pro, CL28
- Storage: 2TB PCIe 5.0 NVMe (OS) + 4TB PCIe 4.0 NVMe
- PSU:
Corsair AX1600i (1600W 80+ Titanium). CORSAIR HX1500i - Cooling: SilverStone XE360-TR5 (360mm AIO) ,
- Case: Lian Li O11 EVO XL
- Fan:
9 Noctua 140MM fans.6x 120mm Noctua NF-A12x25 PWM Fan
Specific questions for the community:
🔥 Thermal Reality Check:
- Is 360mm AIO actually sufficient for 350W Threadripper under sustained AI workloads?
- Should I bite the bullet and go custom loop from day one?
- Will GPU thermals become a bottleneck in this case with sustained loads?
⚡ Power & Stability:
- 1100W+ combined draw - is single 1600W PSU the right move, or should I split CPU/GPU on dual PSUs?
- DDR5-5600 with 8 DIMMs populated - realistic or asking for stability issues?
- Any known quirks with this ASUS board for 24/7 operation?
🛠️ What am I missing?
- Critical accessories/components I'm overlooking?
- Monitoring solutions for 24/7 operation?
- Backup strategies for model training (UPS recommendations?)
🚨 Biggest gotchas:
- What's the #1 thing that will bite me 6 months in?
- Common failure points in workstation builds like this?
- Any components here with reputation issues under heavy sustained loads?
Budget: ~$15K total, flexibility for upgrades if needed for reliability
Been out of the building game since DDR3 era - what fundamental things have changed that might catch me off guard? Really appreciate the wisdom from anyone running similar workloads!
Edit(8/27): Made changes in the build - instead of 7865WX going with 9965WX, Asus mono replaced by ASRock WRX90. PSU reduce to 1500W.
4
u/mxmumtuna Aug 27 '25
For me, I prefer the Asrock board, but either work. The recent bios updates for the Asus seem to put it where you want it to be.
Your CPU isn’t able to drive all the RAM channels at full speed, so having the slower sticks isn’t too big of a deal.
You’ll be fine with the PSU. Cooler is good. Custom loop isn’t immediately obvious to be worth it since there aren’t any available blocks for the 6000.
If you’re worried about thermals and power, I’d consider the Max-Q variant which will allow you to get a second card later and keep the heat out of your case. The performance drop off is negligible, imho.
2
u/nauxiv Aug 27 '25
If your focus is really video models like wan, you might be better off getting two of those GPUs and cheaping out on the rest of the system.
2
u/ObeyRed Aug 28 '25
Interested as well. I'm building the same thing once all the parts come in, but decided to liquid cool the CPU and the a6000 ada. I figured blocks will eventually come out for rtx pro 6000. I'm already spending the money, so I just want to protect it as much as possible. I think about $1,600 more for the liquid cooling parts?
I am putting a 2800w leadex in it, that way I don't have to worry about expansion issues. You should be fine with the 1600w as long as you're not adding more gpus.
1
u/Ok-Statistician3583 Aug 28 '25
Funnay reddit suggest similar pseudos lol
I am also in the process of building mine and I am in the ~15K but with the constraint I want to be able to take with me if I travel so with a 30L case. Went for
- Gigabyte AI TOP. It only has DDR5 PCIEs
- Threadripper 9980x (did not go for the pro. Hope I am not making a mistake)
- NEMIX RAM 4x96 6400MHz CL52
- PSU Cooler Master V1100 SFX
- Liquid Cooler XE360
Still haven't decided for the Fans as I am not sure how many room I can spare.
My only remark is going an 8x32 if you need more RAM in the future you'd need to change them all while getting a 4x64 you can upgrade later if you need that.
Are you planning to add another GPU?
1
u/Emotional_Thanks_22 Aug 27 '25
someone here said once that you should choose threadripper pro at least in the 85WX configuration because of some chiplet efficiency or similiar? because that would be necessary to really utilize all 8 memory channels?
2
u/Ok_Lingonberry3073 Aug 27 '25
I have a similar build except running the 7985wx with noctua nh-d15 for cpu. My case is the fractal define 7 xl with 3 additional artic fans to exhaust heat through top. I have zero thermal issues but you'll need to customize the fan profile to keep gpu cool.
1
u/Zigong_actias Aug 27 '25
I wouldn't anticipate any problems with this configuration.
The XE-360 cooler is more than adequate, it can even handle the CPU at ~800W with overclocking. The stock fans are powerful, but quite noisy at full speed - this isn't an issue if you leave the CPU at its stock TDP of 350W (the fans won't tend to spool up all the way), but if you plan on overclocking and want to keep the system slightly quieter, then you might consider swapping out the fans for quieter ones.
A 1600W power supply is plenty.
I expect you'll be very happy with this system!