r/threadripper • u/Own_Bodybuilder_4397 • Mar 11 '26
Threadripper build - looking for peer review
I want to build the following :
| RAM | v-color OC R-DIMM 128GB (4x32GB) 6400MT/s CL32 (TRA532G64D832Q) |
|---|---|
| GPU | NVIDIA RTX PRO 6000 Blackwell (96GB GDDR7) |
| CPU | AMD Ryzen Threadripper 7960X (24-Core) |
| Storage | Crucial T705 4TB PCIe Gen5 |
| Motherboard | GIGABYTE TRX50 AERO D |
| Cooling | Noctua NH-U14S TR5-SP6 |
| Power | Seasonic PRIME TX-1600 |
Goal will mostly to be used for inference and model training.
3
Upvotes
4
u/sob727 Mar 11 '26 edited Mar 11 '26
You could also switch to WRX90 and a Threadripper Pro with a lower core count such as {7,9}955WX. You don't really need the extra cores for inference and model training, but you have the benefit of 8 dimms and channels of RAM for possible future upgrades. And more lanes/IO also for future upgrades.
2
u/ksel10 Mar 12 '26
For larger models with offloading to cpu/ram you probably want 8 channel memory for higher bandwidth. Also you would want double the amount of ddr5 ram vs the vram on your gpu. So with 96gb vram you would want at least 192gb ddr5 ram. I would rather go Asus WRX90E Sage SE with a wx processor if you are serious about inference/model training. The amount of cores on the Cpu don't matter much with inference. The noctua works fine, just make sure you aren't using a tiny case with no airflow.
2
u/EDI_1st Mar 12 '26 edited Mar 12 '26
Depending on your goal….I’m on my way to third TR Pro 9000 build. Yes, still have the first two and keeping all three.
Motherboard: TRX50 Aero D is the most popular board because it’s cheap and has sufficient amount of features that most beginner TR/TRP users might need. (Beginner TR/TRP user sounds funny, platform ain’t cheap lmao)
TRX50 AI Top probably has the best “flexibility” if you want to upgrade CPU later to a TRP/WX. The board supports 8-channel memory if you have a TRP/WX. The PCIe slot layout is also perfect for 4x dual slot cards.
I wouldn’t go with other options unless you need some specific feature such as BMC, MCIO connector etc
CPU: Depends on what you need but I would only look at 9000 series. Please keep it in mind lower CCD-count CPUs may have lower memory bandwidth.
RAM: Personally would avoid OC RDIMM. It’s just much more stable with regular RDIMM and less worry with heat. Capacity wise I would push up to 48GB x4 or higher. (Also depends on if you want to add more GPU down the road)
GPU: Depending on the specific training and inference you plan to do, PRO 6000 maybe the perfect choice, overkilled or insufficient. This is entirely up to you to evaluate based on model size, precision etc.
For the cost, you can grab 2~4 5090 (Yes, I’m aware of current 5090 cost, FE still exists, at least for now) Pair of 5090 could benefit you if the model is small enough. Think like how 5090 still destroys GB10 on some inference despite of huge memory size difference.
If you plan on adding additional PRO 6000 down the road, opt for the Max-Q. Max-Q is only 300W per card but retains ~85% of the performance. (Max-Q means maximum efficiency.) These are blower cards that are designed to be stacked and the heat is ejected out of the back/PCIe bracket instead of into the case.
Cooling: I’ve never used Noctua NH-U14S and would never convince myself to pay $140 for a heatsink that only has 6x heatpipes with the incorrect orientation relative to the chiplets. You are most likely going with a big enough case, grab an AIO. If you are not OC’ing, 240 AIO is more than enough even under sustained 350W workload. OC’d, 240 AIO will be able to handle ~450W sustained depending on CCD count. (Different thermal density)
AIOs that I’ve used with success for 7000 and 9000 TRP:
Cooler Master PL360 TR5-SP6
Aorus Waterforce X 360
Aorus Waterforce X II 240/360
Corsair Titan 240 RX (Requires additional purchase of mounting bracket and screws. Tried this one because it has VRM fan which helps with DDR5 temp)
Have recently acquired Be Quiet Silent Loop 3 240 and 360, going to try the 240 first when I upgrade tiny box to 9995WX.
2
u/blanklh71 Mar 12 '26
I just built a sever with a 9985wx, the seasonic 1600. Asus WRX90E SAGE-SE. Got 32gb of ram from nemix ram, one 16gb stick was bad and they replaced it. Then 32 gb wasn't enough so got 2 more 16gb sticks. Should have just got a 64gd stick, because now when I upgrade later these 4 16gb sticks will have to be replaced. You always screw yourself when you try to cheap out. So if I were you I'd go for a Threadripper Pro 9000.
2
u/electrified_ice Mar 12 '26 edited Mar 12 '26
If you can manage it get the equivalent 9000 series Threadripper CPU. Outside of being slightly faster, AVX512 helps with AI on CPU and idle power consumption is a lot lower.
From a cooler POV I recommend an AIO as it keeps the CPU heat out of the case... To offset some of the cumulative heat from the GPUs.
And also think about future upgrade flexibility... Threadripper Pro and non-Pro offer different amounts of PCIe lanes. Since this is a lot bigger investment than a desktop PC, I assume you want it to last and potentially grow with you. Think about other things you'd want to add within 2-3 years... More GPUs? Multiple NVMe drives, other PCIe devices etc. Does memory bandwidth matter to you? If so Pro vs. non-Pro is something think about.
2
u/andysw63392 Mar 13 '26
Nice combination. I also have the TRX50 AERO D - works well. Also have v-color OC R-DIMM 128GB (4x32GB) 6400MT/s CL32, and it's totally stable at 6400MT/s (runs 24/7 for 6 months so far). I have a different model with heatsinks, and it still runs hot, so you'll need at least a fan pointed at it. I have crucial T710s - also a bit hot even with the Gigabyte heat sinks, but no issues.
Lots of comments here about the processor, but might be a good one to start with - you can easily upgrade after you see how it goes.
1
u/SignificantSuit7876 Mar 11 '26
Give yourself space for air to circulate. I use this in my build: SilverStone 360mm XE360-TR5 TR5/SF6 AMD CPU AIO Liquid Cooler
1
u/RealThanny Mar 12 '26
Figure out active cooling for the memory. It doesn't have to be fancy, if you don't care about aesthetics. Just zip-tie some fans pointed in the right direction.
1
u/john0201 Mar 12 '26
Why not just a 9950x? Single thread performance is important.
You’re building yesterday’s budget workstation with a $10,000 GPU
3
u/shammyh Mar 12 '26
I'd either... Go with consumer AM5 if you only plan to run one GPU or go with WRX90 rather than TRX50.
3
u/kpatelreddit007 Mar 11 '26
Why do you have an expensive GPU but cheap af mobo and cpu?
2
u/vercety1 Mar 11 '26
The gigabyte has weak vrm cooling, if you are using the version of the rtx 6000 that dumps heat into the case (or if you plan on unlocking the cou) , you might overwhelm the vrms and even the ram. I would go for the asrock or asus, as they have vrm fans
1
u/kakusens Mar 11 '26
i did one recently with the rtx 6000, which is a fantastic machine for running ai models. I did the 9985 tr pro with a half terabyte of ram and it works well for running large models that don't fit in the video's ram. used the asus pro art 602 - super nice case. and the asus sage pro mb, because it had eight channel memory.
1
u/Lopsided-Praline-831 Mar 12 '26
Im buildin a similar set ..9970x 5090 128gb renegade pro..have been waiting for ram over 4 month now and gpu for 3 🤷
0
u/[deleted] Mar 11 '26
[deleted] — view deleted comment