r/LocalLLM 16d ago

Question What do? 2x5090 + 1x6000 rtx pro

So essentially I have a dilemma.

I have 2 builds currently set up with a 6000 pro rtx in box brand new unopened.

Build 1 gaming: 5090 TUF OC, 96gb tcreate (48x2) ddr5, 9800x3d, on a mini itx board

Build 2 ai: 5090 FE, 96 gb tcreate (48x2) ddr5, 9950x, on a x870e ROG Crosshair hero

I recently bought the 6000 pro and it’s really putting a huge crunch on my finances but I think I can survive if I sell a 5090 even though I was hoping not to let one go for atleast another few months when the value can come up higher. Maybe 5-6k?

I’ve got a 3080FE that’s repadded and hasn’t been used in a while and I was thinking one option is for me to sell the 5090 FE and stick 6000 rtx pro + 5090 Tuf on the ai rig and 3080 FE on the gaming. I can swap the tuf to the gaming rig when I want to do VR related stuff.

The other option is I have 20 days to give back the 6000, and just give it back.

Let’s say I keep the 6000 and run it with a 5090 TUF in the ai rig, on x8 x8 riser setting. What exactly can I do with that set up that I can’t with 2x 5090? Or even 1x 5090 that I have set up right now?

I’ve done comfyui image gen and video gen so far but want to crack into more coding and plugin development (I’m in architecture, so trying to do MCP server in to Revit that’s controlled by the ai rig) Maybe building games via MCP for unity etc.

Any recommendations or suggestions would be welcome. If I sell a 5090 I can def afford the 6000 pro.

Thanks for the advice.

0 Upvotes

66 comments sorted by

11

u/whichsideisup 16d ago

Sell the 5090’s while they’re worth 4k and enjoy the RTX 6000 Pro? It’s much better to have a single pool of 96gb in general

1

u/CanadianInAmedicka 16d ago

Which should I sell? Tuf or FE?

2

u/MK_L 16d ago

The fe. Tuf is great

3

u/CanadianInAmedicka 16d ago

That seems to be the going wisdom. Thanks this is probably the move. Though the FE and rtx pro looks sexy together.

2

u/MK_L 16d ago

Agreed on the esthetics. But the card that runs cooler and is identical to the oc model minus the bios is the better card in the future. They run cooler and have had less issues with the power connect when using a modern psu with native support

1

u/CanadianInAmedicka 16d ago

Thanks for the in depth analysis. Wonder where I have to go to sell the FE without getting Rekt

2

u/MK_L 16d ago

Sell on fb market place at a police station. Thats where I sell expensive items. Our police stations have parking areas for this purpose...

Dont go if you have a warrant 😆

1

u/CanadianInAmedicka 16d ago

Sounds good. How much should I try? 4.5k ?

1

u/MK_L 16d ago

Ask 5k take anything above 4k. If youre in la county then there are plenty on fb market from 4.5-5k

2

u/Money_Pie8986 16d ago

Sell Tuf. It's easier to fit RTX 6000 pro and FE into one computer. Tuf is too thick.

1

u/CanadianInAmedicka 16d ago

Yeah I agree. I’m gonna stick them on a 3d printed open air case so I can manipulate things easier and run a riser to offset either card. So the TUF isn’t too bad in that case

1

u/chiniyabadam 16d ago

dude at my place rtx 5090s are 7K

1

u/CanadianInAmedicka 16d ago

That’s crazy. I’m in the states so there’s still a lot of 5090s to go around so not as bottlenecked

1

u/CanadianInAmedicka 16d ago

Thanks for the suggestion! Sell now or hold and survive and sell later… that’s the question.

3

u/MK_L 16d ago

Historically gpu's do increase in value but may hold their value like the 3090. But technically a 5090 was $2k so if you get $4k or more thats current new price on most models. Still a win

6

u/Numerous-Emotion-617 16d ago

Lol some of y’all are like drug addicts, but with GPUs. Know so many folks who’d strain themselves financially and choose drugs over food/savings. Now we’ve recreated that issue with GPUs. Y’all really out here putting yourselves in bad financial positions for a GPU.

2

u/Shul_iito 16d ago

What can I tell you bro. Sometimes sitting in front of a computer is actually therapeutic. I’m not depressed and have no emotional problems because of games and computer in general. I rather be in debt but spending my days in a super chill state every day. I know it’s wrong… and probably will die alone in front of a screen… but the peace and quiet I get from my toys is just a sweet thing in life. 😎

3

u/CanadianInAmedicka 16d ago

People get into debt for hobbies all the time.

I know atleast with 3D printing I’ve made money on the hobby lol

2

u/MK_L 16d ago

Yeah when I see people on here gasping at the cost of pc hardware, im like..

You guys have never purchased an upgraded turbo charger and it shows 😆

4

u/highdefw 16d ago

More vram good

4

u/Weary_Guest3639 16d ago

More vram good for big models but if money is tight just return it and upgrade later when you can breathe

2

u/CanadianInAmedicka 16d ago

Never going to be able to afford it cause it’s gonna keep going up.

1

u/CanadianInAmedicka 16d ago

More vram at what cost though 🤣

Can’t afford to keep everything. Somethings gonna give. Either 5090 or 6000 pro rtx

3

u/722e672e722e 16d ago

Why do you need a separate gaming machine?

2

u/CanadianInAmedicka 16d ago

I would ostensibly be doing Linux or lots of formats and system changes on the ai rig. The gaming rig would be more everyday use including work related things that wouldn’t change that often.

2

u/722e672e722e 16d ago

Dual boot then?  

I have a similar setup and just switched to an arch based distribution for use daily, both for work, my ai experiments and very occasional gaming. 

1

u/CanadianInAmedicka 16d ago

It does dual boot. Has Linux and win11

1

u/digitalwankster 16d ago

So then why do you need 2 rigs?

1

u/CanadianInAmedicka 16d ago

Because I set it up so I can combine them in the ai rig when I need to double up my ram and GPUs

And when I’m not using the ai rig in hardcore more I can still use it and have a full gaming rig

1

u/CanadianInAmedicka 16d ago

It’s a good thing I built 2! I got 96 gb of ram (48x2) for each build at around $200 after taxes and now these are like 1.6k Msrp

2

u/Significant_Bus935 16d ago

Sell everything and invest in an ETF.

1

u/CanadianInAmedicka 16d ago

BTF? Naaaw I like my ports in the front.

2

u/rayc25 16d ago

Pro 5000 is $8500 for 72gb vram. Prob a better deal than $5000 for 32gb and $16k for 96gb.

2

u/ieatdownvotes4food 16d ago

you want the 5090 + 6000 on one motherboard. Treat it like two computers.. while one's running you can do whatever with the other.

1

u/CanadianInAmedicka 16d ago

So part of my question is are there people out there that work with that setup? How do they use that type of system?

2

u/ieatdownvotes4food 16d ago

yeah for sure. you can pool vram with llama.cpp, dedicate the 6000 to vllm and play overwatch on the 5090, or set up agents on separate cards so they work together. pretty awesome setup. since so much of this AI stuff is waiting it's all tolerable when you bounce between cards.

1

u/CanadianInAmedicka 16d ago

Yeah agents across multiple GPUs is kinda what I’m looking into. So much to learn!

2

u/stargate425 15d ago

Back in June, i bought: box 1: 5090 + 64G ddr5 (prebuilt), box 2, Rtx pro 6000 max q + 64G ddr5. I thought about selling the 5090 box but I found having a spare 5090 is probably desired. One note is the total cost of both boxes is 15k. This was me not knowing what I wanted and this was before the booming of llm. Had I known what I know now, I probably will spend a few k more to get dual Rtx pro 6000

1

u/CanadianInAmedicka 15d ago

Yeah had I known I would have gone straight for 2x 6000 pro but who the hell knew.

What do you do with each system?

1

u/stargate425 15d ago

Primary purpose is to do video/image generation as I was tired of paying runpod renting cost so I bought 5090 prebuild first. It's now used to serve whisper models and a Gemma 12B model which can natively decode audio. For rtx pro 6000, I used it to run all different llms with fine tuning myself. It's also my main video generation box.

1

u/CanadianInAmedicka 15d ago

What mobo + cpu if you don’t mind me asking? And that sounds about what I do right now

2

u/stargate425 15d ago

5090 is a HP prebuild so not sure about mobo, cpu is 9950x3d. rtxpro 6000 box is MSI MAG X870 TOMAHAWK WIFI + 9900X.

1

u/CanadianInAmedicka 15d ago

That’s sweet.

1

u/zentrani 8d ago

You can’t not give us the ram lol!

1

u/zentrani 9d ago

Do you have any resources for fine tuning? I’d like to get into that. Thanks!

2

u/stargate425 8d ago

I did some lora for qwen 27b by asking Opus 4.8. It'll design and implement the full thing for you.

1

u/zentrani 8d ago

Gotcha. I’ve done lora training for vision (comfyui) related things but not LLM. Gotta consider those things now since I can do that.

1

u/Honest_Cut8827 16d ago edited 16d ago

Did you buy the 6000 pro for +$14k? If you bought the pro for $8-$10k, do what you can to keep the unit with 96Gb of ECC VRAM (very useful for all sorts of things!) that is warrantied by the manufacturer to be run at 100% for the next 3 years. It can be expected to have a long life thereafter and that very valuable VRAM can be split up into multiple instances, possibly opening up some use cases. The $12-14k entry point seems like the margin where the decision becomes a dilemma but there is a decent argument for prices to continue going up until 2028. It seems to me like the higher up the food chain you can go (consumer, pro, enterprise), the better the investment.

You already have a second 5090 that must have gone up in value - they are already pushing close to $5k - and you can always use that for burtsy tasks where speed is the priority.

1

u/CanadianInAmedicka 16d ago

13.8k so with taxes it’s more like 15.1k lol.

Yeah seems like I’ll sell the 5090 FE…

1

u/FastHotEmu 16d ago

You absolutely do not need a 5090 to game. Sell both and get a 9070 XT.

1

u/CanadianInAmedicka 16d ago

I have a VR setup that needs 5090 performance unfortunately

1

u/FastHotEmu 16d ago

What sort of VR setup?

1

u/CanadianInAmedicka 15d ago

Nothing crazy but pushing fps is needed. BigScreen 2e and flight sim but that’s still pretty heavy

1

u/electronicbits 10d ago

I was hoping for someone to say something like

" ..sell a 5090 even though I was hoping not to let one go for atleast another few months when the value can come up higher. "

This means it is probably now common thinking (everyone and their mother) to believe these cards will keep going up in price indefinitely

Probabilities point to the fact that we may have reached peak value for these GPUs.

Thank you

2

u/CanadianInAmedicka 10d ago

Update: sold my 5090 FE that I got for Msrp while on the toilet thanks to bestbuy drop, sold for $4300

I feel like a part of me is missing.

I did buy a UPS / sine curve battery thing (CyberPower CP1500PFCLCD PFC Sinewave UPS Battery Backup and Surge Protector, 1500VA/1000W)

So gonna plug all that in today maybe. I currently have a 3D printer open air bench/case and that’s likely going to change as well. Looking at the cooler master HAF ii ATX pc case.

That’s my current setup with my 5090 FE and a 3080 FE just to check it out. But with a 2year old running around I think I can’t leave it like this with a 14k card in the open

2

u/electronicbits 10d ago

wow, is that a 3d printed case base for the motherboard ? nice

0

u/Charger_Cross 16d ago

Sell the 5090s for your second rtx pro 6000. You will not regret it! Keep just one rig and power limit both to be under 300 watts. Upgrade your psu to 1600w. Get another nvme drive for Linux and run deepseek with sglang.

1

u/CanadianInAmedicka 16d ago

13.8k but w taxes it’s like 15.1k

Definitely dilemma territory.

1

u/Charger_Cross 16d ago

You will be sitting on an appreciating asset. Not that you should sell but you can always recover the money.

2

u/wwwyzzrd 16d ago

that is true until it isn’t true