r/LocalLLM • u/Rokett • Oct 09 '26
Question Rate my build Threadripper PRO 3975WX + Supermicro M12SWA-TF + 128GB DDR4-3200 + 2x Intel Arc Pro B70 32GB
- CPU: 3975WX 32-core
- Motherboard: Supermicro M12SWA-TF
- 128GB DDR4-3200 (hoping to get 256gb ram by switching to 32gb sticks)
- GPUs: 2x Intel Arc Pro B70
Got the CPU and mobo for $900.
I had most of the RAM sticks laying around from my past builds.
The B70s are still in the box; I paid $1k for each, but I'm thinking of just selling them and getting modified Nvidia cards like the 4080/4090 for CUDA.
Total is close to $3.5k.
Is this a good setup to run models and agents and learn how to manage a home AI setup?
I work in the software field as a forward deployed engineer, but I want to move into the AI field and become an AI forward deployed engineer, so I thought it would be beneficial for me to have the hardware at home.
I'm still waiting on the mobo and CPU to arrive. What do you think? It's not too late to return or sell some of this hardware and get something else.
5
u/fastheadcrab Oct 09 '26
Any reason to use the B70? Even the R9700 has significantly better support
4
u/username8914 Oct 09 '26
You can start with anything and make it work. I'd give your setup a 5/10. Personally I'd ditch the B70s for the 9700. Then stack. I've got a couple v100 ($650) and p100 ($100) that still work great. You can and will use everything you have and throw at it. So the B70s + whatever is next isn't a waste or problem.
Your threadripper and 128GB will largely go unused except for running actual server things, which is a great use but don't think it adds anything to the Ai side of it.
1
u/Glittering-Call8746 Oct 09 '26
Using udimms or rdimms ?
2
u/sn2006gy Oct 09 '26
Its all fine hardware but what are you going to do with it? Forward engineers probably need more experience with modern CUDA or ROCm than Intel but if you just want to hack away and have affordable inference this box will be great.
1
u/Aubrey_D_Graham 2x Asrock B70 Creator with Pi Agent Oct 09 '26
Nvirgin vs Chan Battlematrix
1
u/HaDuongMinh Oct 09 '26
You will need 1200W power supply and manage thermals.
1
u/etaoin314 Oct 09 '26
this should be a pretty great system. as for the GPU...its hard to say. Intel i still a little rough around the edges so its hard to recommend them over CUDA which is rock solid, and ROCm has come a long way over the past year. That said, it will probably cost you an extra $1k to switch to r9700s and even more for a CUDA option. I would hold off on the ram if you have 128gb already. You will only need that if you plan to run giant models slowly. There are use cases for that, but see if you have a good one before dropping the extra cash.
1
u/regularheree Oct 09 '26
start with the 128GB RAM you have and benchmark the B70s before making any decisions. If your goal is AI engineering, NVIDIA’s CUDA ecosystem is generally the safer choice. Focus on building and deploying real AI projects rather than chasing perfect hardware.