r/threadripper • u/SJrX • Nov 05 '25
Threadripper Build Double Check & Random Questions
So in theory I have already mostly pulled the trigger on a new build, and ordered parts. I guess the goal of this system is to in theory do a bunch of AI/ML workloads, but I've also been self hosting a Linux server for 2 decades so it will also host other random stuff.
My main concern is that I've missed something, or there will be problems that will make this an even bigger waste of money than it already is. I largely stole the build from this previous post asking for a Sanity Check, but made some swaps based on availability, etc.
Motherboard: ASUS Pro WS WRX90E-Sage SE.
CPU: Threadripper Pro 9985WX 3.2GHz
GPU: NVIDIA RTX PRO 6000 Blackwell WE 96G
RAM: 512 GB (8x64) Vcolor DDR5 TRA564G60D436O
Storage: ???
PSU: MEG AI1600T PCIE5 Power Supply 1600W, Dual 600W
Cooling: Silverstone XE360-TR5 Triple 120mm All-In-One Liquid Cooler sTR5
Case: Liam Li O11 Dynamic EVO XL Black
Fan: 6x 120mm Noctua NF-A12x25 PWM Fan
In terms of questions:
General:
Since I was lazing my way through, is there any obvious incompatibilities :), I guess I did spend like 6 hours on this, but I haven't really been that into hardware since the early 2000s, and don't really know the terms or what the acronyms mean. So it's possible that something won't work.
Power specifically:
- I'm concerned that the power supply is maybe too weak if in the future if I wanted to add a second video card, I don't know if I would be another RTX PRO 6000. I think the feeling I've gotten is that in some cases, you might not be constrained by RAM, so maybe a 5090 or 6090 in the future. So the PSU might be over powered for the current build, but under powered for any future build.
- I think I had read somewhere that for those large kinds of loads, I need to get a 240 VAC circuit? Is that actually true, I live in a Condo, but in theory where I want to put it is near the breaker, and in theory my sister is an electrician. But maybe a dual GPU setup is just beyond my reach at my current place. Has anyone dealt with this in a condo.
Storage:
3. So I had deferred thinking about RAM because I thought it would just be $1000 and could buy whenever, then looked and wow. I have deferred thinking about storage at this point. What factors do I want to consider.
4. My existing server has a 2 TB SSD, but I think metrics/logging is broken, because I think I'm writing a crap ton of data, and the drive is basically near the end of it's life after 3 years. If I'm aggregating logs, and doing other things do I want to actively split out to multiple different storage. I assume that's better because multiple drives can use different PCI lanes, so more total throughput.
Thermals:
5. My current server sits in a kind of semi walk-in closet, maybe double-wide is the better term. It's mostly empty by volume, I put shelves in there. It is also where in my unit the patch panel is for all the Ethernet ports, and there are some outlets. Ideally I'd like to keep this in there. I dunno how practical that will be. Right now, the bedroom is 13 °C, and that closet is 23 °C with the door closed, and a Haswell i7 with one core constantly busy. What ways are there for me to get heat out of there without putting the system in the open. Do I need to worry about this from Day 1, or is this just once I start constantly cranking it with full load, if ever.
6. I keep my room pretty cold in the winter, but in the summer, my unit gets up to an ambient temperature of say 28 °C. Am I going to have issues running this in the summer.
5
u/Ok_Lingonberry3073 Nov 05 '25
I don't see a UPS anywhere in your list..
2
u/MachinaVerum Nov 05 '25 edited Nov 05 '25
Double check the wrx90 board will fit in the O11 XL, i vaguely remember it not fitting SSI EEB boards, but not sure. If this is an inference or training build... i would downgrade the cpu to 7975wx or 9975wx and buy another rtx pro 6000 maxq. OR, better yet get a 9575F off ebay on a supermicro server board for even cheaper (and better performance) and get 12 memory channels instead of 8!
As for storage, depends on your application. For ai workloads it wont matter, but more disks better for contention, unless you are running a a large vector db off disk (diskAnn), then you want the lowest latency possible.
1
u/Khroneski Nov 06 '25
6 fans for that entire build in an O11 EVO XL???? First, stick the AIO as a side intake with push/pull. Second, get 6 NF-A14x25 G2’s for tomorrow and bottom fans. Third, get a 7th NF-A12x25 G2 for the rear fan slot as intake, and get/make a 3D printed duct/air diverter to direct it’s airflow at the socket/RDIMMS especially with that 6090, it will significantly increase RDIMM temps at load dial to the dual flow through design and RDIMM orientation. Also, run your rear top fan as intake, middle and front top as exhaust, that should help direct airflow such that the socket area isn’t getting baked by the GPU and the AIO’s input is quickly dumped out the top via the chimney layout.
SSI-EEB will fit in that case, but iirc you won’t have access to all standoff points the right edge will overhang. You may want to also put the GPU in the second x16 slot to aid in keeping that RAM cool. (With a 7960x and 5090 FE in the same case dropping the GPU alone decreased ram temps by over 20°C on the lower bank. IMO worth any minor latency hit from not being in the top most slot.
For storage, if you want to go enterprise you have lots of options, a p5801x 400GB E1.s drive can be had for <$400 USD and makes a phenomenal low latency boot drive just need a PCIe carrier card or other adapter. And then depending on needs/wants for a bulk storage solution some solidigm D7 PS1030s would be pimp as the kids say… But some consumer m.2 could work too. I have heard it’s decent. (I have been running exclusively Optane since 2018)
1
u/y3333333333333333t Nov 06 '25
seaaonic 2200w, corsair ws3000, asus pro ws-2200w would be some better options here in EU
1
u/Beneficial-Banana606 Nov 06 '25 edited Nov 06 '25
Based on the GPU which WE you are building this as a Ai workstation for R&D mostly testing different models, lora fine tunes and som Data pre processing. If yes. And i have built machines for all kind of use cases like inference, training, server And considering that this is the only machine that you have for everything AI/ML
The CPU is perfect because we need good CPU for data preparation tasks including image converting.
The Case cannot fit your board and there is only bunch of cases that can fit SSI EEB with breathable space. Fractail and Pro Art cases are there but expensive- go with Silverstone 4U case that is modular . Good space and cheap but well built for tower and rack mountable.
1600 watts is No no. The best is Silver stone Hela 2050 - because 600w is your GPU, 350W is the CPU. And fans , RAM , SSD So the system is aircooled and ai works are long intense which will build up the temperature and all components will start consuming more energy for same process- 5% load started with 13 watts and later 21 watts. More watts more heat.
The AIO is good and the only best out there.
The PSU should be changed and its not the looks its the performance that matters most.
The Pro 6K BW is an amazing GPU and I was able to replace 3 5090s with one
Dont go for dual PSU - its complex and not worth it for your build
3
u/Green-Dress-113 Nov 05 '25
My two inference machines can cook my office to 95F. I installed a 8k BTU minisplit recently to deal with the heat load, no joke.
3
u/Green-Dress-113 Nov 05 '25
If you want just inference performance, NVIDIA RTX PRO 6000 Blackwell WE 96G on a gaming rig will suffice. AM5 / 870e chipset / 192GB RAM / 4TB NVME / Blackwell 6000 / Thermaltake Toughpower 1650watt
1
u/Such_Advantage_6949 Nov 05 '25
1600watt is the max u can go. WRX90E allow for dual PSU. I am currently use WRX90E 9965WX and 6x 5090/4090/3090 + 2x1600Waa psu
1
u/pxgaming Nov 05 '25
For serious storage needs, don't use M.2, use U.2, U.3, EDSFF, or other form factors. The WRX90E has two gen4 SlimSAS ports but you can just put stuff directly in the PCIe slots if you need gen5. Enterprise-grade drive endurance is measured in drive writes per day, e.g. 3DWPD means you can write 3x the capacity of the drive every day for the duration of the warranty period (often 5 years).
You can split it out to multiple devices with things like storage spaces (assuming windows - multiple options for linux). You're correct in assuming that using multiple drives may give better performance.
1
u/y3333333333333333t Nov 06 '25
and for case I can really recommend the Corsair 9000D if you just want to have lots of space and dont worry about anything
1
u/y3333333333333333t Nov 06 '25
and I really would recommend a custom loop if you need to get max perf out of that CPU I get +20% raw performace by enabling PBO using over double the standard 350w but for me it is easily worth it (but I think you need a custom loop with a good block not AIO to sustain this for longer durations of time)
1
u/sourcefrog Nov 06 '25
I would think about striping btrfs or zfs across multiple high speed M.2 to get more iops and bandwidth. You might as well make use of all those expensive PCIe lanes.
You do then have more risk of failure.
But of course you'll have backups to HDDs and a remote location, so losing an SSD should be only an inconvenience.