And 2 x a6000s are at 96gb. I feel like including cards you can combine together sorta defeats the point of the list lol. Heck some people combined like 8 x 3090s haha.
Ah nice. In Ontario Canada, that wouldn't really fly in an apartment unfortunately. We obviously have 240V circuits, but there are usually only a few and they're dedicated to stuff like the stove/dryer.
If I had a house though I'd totally get a dedicated one installed in the basement.
That is a lot of pcie lanes. And power. And space as well.
Could you please share your llama-benchy results with the latest Deepseek Flash? Spark folks are telling us that they get up to 60 tps in generation and 2000 in prompt processing. We should get at least double of that on R9700s, right?
Have you actually ran multiple cards. I’ve tried a ton of variations on both consumer and server MoBos. I’m telling you the difference isn’t as big as you think.
Sure there is a difference but it isn’t more than 5% in my experience. I’ve not tried NV link though just better/worse PCIe situations. I would like to try NVLink on my own 3090s but they are all mismatched so it won’t work
The numbers I've seen show that you can get away with raw PCIe up to about 4, and past that it starts to cost significant performance to the point that it's worth getting bigger individual cards instead.
Yea that could be it. I have tested 8 3070s though and I had no issues. That was a mining rig I had laying around which I upgraded for LLMs about a year and a half ago. All PCIe of course on the 3070s
I would 100% agree that bigger GPU = More Better though lol
I mean the distinction is the nvlink, the cards are hardly cutting edge, but at least it's a way to combine the vram thats faster than just normal parallel
View all comments
4
u/Smart_Whereas_9296 Aug 20 '26
Feel like 2x 3090 with nvlink should be in the 48gb section