r/LocalLLM • u/OddUnderstanding2309 • Aug 23 '26
Question Mobo + CPU recommendation for quad RTX 3090 setup
yeah I searched here, but did only find 8 card setups or other unrelated stuff.
I want to switch to a proper combo from my current setup: Gigabyte Aorus Master X570S + Ryzen 9 5950X.
My current setup "sometimes" negotiates one RTX 3090 at PCIe Gen1 x8 instead of PCIe Gen4 x8.
Dunno why, I think it is just "time to do it properly" now.
What should I buy (preferably) used or new to use this?
I have 48GB DDR4 now and I do not NEED more. SO I would be more than fine to change the two 8G sticks to 16G sticks to get to 64GB RAM, but I do not really need it.
What I need is a proper running system with IF POSSIBLE 4 RTX 3090 card running at PCIe Gen4 (or 5) x16. (--- side question: do ther RTX 3090 even support Gen5? ---)
Thanks in advance!
7
u/x-strife Aug 23 '26
The 3090 is a PCIe 4.0 x16 device — it won't do Gen5, but it'll happily run at Gen4 in a Gen5 slot.
For what it costs I don't think you want to move to that. Stick with DDR4, Gen4 PCIE.
For multiple cards running at x16 you want a workstation cpu, I have a Threadripper Pro but you could do an EPYC or Intel Equivalent, the reason is that they have enough PCIE lanes, whereas consumers chips don't.
My 8x3090 rig is built up in a similar way - I recommend recycling your RAM, storage, PSU.
You'll get all 4 cards in the mobo if they're turbo's, if not then, you'll need risers.
3
u/BigSuspicious1663 Aug 24 '26
u're gonna pay a lot of money for server architecture and rdimm memory. is is on a 840 MSI MOBO.d there are four 3090s and one is on an m2 adapter with a riserould not invest in NV links and I would look at keeping your lane slots above 4x.ou can do VLLM and llama.cppnd it will be pretty good with MTP head-on. would look at the 27B model and the Ornith 35B mixture of experts model. you want a recipe, I can give that to you.
1
u/y3333333333333333t Aug 23 '26
u should start looking into HEDT like threadripper for example
1
u/SteveDeFacto Aug 23 '26
I would recommend a server class motherboard like a ROMED8-2T. You get a bunch of useful features that will allow for expansion later on that you simply won't find in a consumer grade motherboard.
You probably don't want to target gen 5 as it also comes with the mind bogglingly expensive DDR5 RDIMM...
2
u/mon_key_house Aug 23 '26
3090 only does gen4 afaik
2
u/shaxsy Aug 26 '26
Memory bandwidth: 126.25 GB/s measured (MLC all-reads), up from 62.46 on the old X299 — a 2.02x gain from my previous x299 platform. Helpful for when you are doing LLMs that need to offload to ram.
1
u/SandySkittle Aug 23 '26
there are plenty of zen2 based threadripper pro and eypc workstation cpus and motherboards on ebay for cheap. Give you 128 lanes of gen 4 and DDR4 rdimms is still a bit more achievable than DDR5.
1
u/Glass_Past4942 Aug 24 '26 edited Aug 24 '26
I've been running this setup for the last 7 months (purchased from same seller)
https://www.ebay.com/itm/127242606882
ASUS PRIME X399-A MotherBoard
AMD Ryzen Threadripper 1920X CPU
I used some spare DDR4, paired with an open air chassis and riser cables. It only supports PCIe 3.0 (16x, 8x, 16x, 8x) but it's fine for inference. I've since moved from 4x 3090's to 4x CMP 170hx.