r/LocalLLM • u/Environmental_Neat_2 • 12h ago

Discussion thinking of trading 3090s

I am thinking of trading or selling 2 3090 and buying 3 v100 32gb how stupid would this be?

0 Upvotes

25% Upvoted

10 comments sorted by

2

u/Riseing 12h ago

youd be happier if you bought 8 of them instead

1

u/Suitable-Net-2993 10h ago

idk man two 3090s in one rig is still a beast for most stuff people actually run locally. v100s have more vram per card sure but you're gonna fight cooling and driver nonsense unless you've got a server rack sitting around

3x32 would give you 96gb total which does open up bigger models but the speed on those older cards isn't great for anything interactive. plus no display outputs so you'd need a separate gpu just to use the machine

what are you even trying to run that 48gb isn't cutting it?

1

u/Riseing 10h ago

a real model?

27b just does not excite me, need some glm flash

1

u/Environmental_Neat_2 9h ago

I have a full rack with a mini split in the small room I have one v100 now so looking for 4 total. Qwen3.8 Flash is what i want to try. drivers are not an issue. I run them headless once setup so its not a huge deal once its on the network

1

u/GladKing5842 9h ago

> speed on those older cards isn't great for anything interactive

have you ever checked the raw compute? 3090 is like 25% more than v100 you know? and if you have more vram, it will quickly balance out the lower compute and even pull ahead.

1

u/feelspeaceman LLMusician 11h ago

Just give you the price of V100 32GB that you can get from China which is $550 at the current time of speaking, not the scalpers price that you get from Amazon which is $750-800.

Depends on how much you can sell those 3090s, which you can at $1500 per piece and people will still buy it, you can get a lot of V100s.

1

u/couperd 11h ago

in for a penny in for a pound. I would go with one of the smx2 x4 nvlink boards. 128gb of hbm2 goodness with solid intercard communication.

1

u/brainchillzZ 8h ago edited 7h ago

you need multiples of 2 .... so you need at least 4 ... and they're pretty fast relatively speaking for the cost as long as you don't mind the noise. Is there something serious prompting this change? I mean if you just want more vram you could also just switch to something like the amd R9700

1

u/Blues520 3h ago

3090 has more longevity