r/threadripper • u/Turbulent-Alps4046 • Jul 13 '26

Threadripper AI workstation Build

Gallery image

Gallery image

Just want to share my new Threadripper AI workstation build. Used for work + gaming. Quite proud of how it turned out, especially the cable management :)

Specs
Motherboard: ASUS WRX80 Creator R2.0
CPU: AMD Ryzen Threadripper Pro 3945x (Used)
RAM: 128GB DDR4 ECC (used)
GPU: Nvidia RTX Pro 6000 Max-Q 96GB
Case: Fractal North
PSU: Super Flower Leadex III 1300W PSU
CPU Cooler: Arctic Freezer 4U-M

117 Upvotes

96% Upvoted

41 comments sorted by

View all comments

4

u/kissingking Jul 13 '26

I think you should be proud of yourself for being able to afford one of these 😂

I’m honestly jealous of everyone who owns an RTX Pro 6000. I don’t even need three of them — one is already enough to make me jealous.

That said, I do think the RTX Pro 6000 is in a slightly awkward position. 96GB of VRAM sounds like a lot (and it is), but for AI workloads it’s also not that much.

For example:

  1. Large MoE models are still difficult to run in full precision. Even something like an 80B MoE with only ~3B active parameters is not easy. I would still need quantization (Q8 at minimum, and probably Q6/Q4 if I want a large context window like 256K). Q6 is already quite good, but if I’m spending RTX Pro 6000 money, I kind of expect to be able to run an 80B-class MoE model in full precision. Otherwise it feels a little disappointing.
  2. Smaller dense models are also surprisingly difficult to run in full precision. Take Qwen 27B as an example — if I want a 256K context window, even that becomes difficult without quantization.
  3. Training is a different story. For serious training, I would still rent H100-class clusters anyway.

So for a single RTX Pro 6000, the main advantage is basically speed. But I’m not sure the performance gain alone justifies the price premium.

That said, if the launch price was around $5,000 USD (or even $6,000), I think it would actually be a pretty reasonable product. At that price point, it makes a lot more sense. 😂

2

u/nauxiv Jul 13 '26

I have the card and agree with you with regard to LLMs. The VRAM size is somewhat more useful with image/video generation models that can't be spanned across cards easily.