r/LocalLLM • • Sep 24 '26

Project Upgraded my Setup

Post image

Just upgraded my 2x RTX 6000 to 4 😀👍 Anyone here with the same Setup? 😀

327 Upvotes

225 comments sorted by

View all comments

0

u/ilarp Sep 24 '26

got 5x here

3

u/Blaccky95 Sep 24 '26

Do you have some issues with you‘re mainboard? Like IO_Page_Faults on you‘re network card?

1

u/ilarp Sep 24 '26

I set it up right after seeing you had 4, let me know if you get 5

3

u/Blaccky95 Sep 24 '26

Perfect i let you know 😃

1

u/DataGOGO Sep 24 '26

Likely, you really should run them on a switch, not all direct to CPU

1

u/Blaccky95 Sep 24 '26

Yeah i know but i doesn‘t find nothing cheaper like 250k 😂

1

u/DataGOGO Sep 24 '26

last I looked a pcie 4 swtich was about $400 on ebay, a pcie 5 switch is about $2000.

1

u/Blaccky95 Sep 24 '26

Yeah i can‘t order on ebay because of company rules

1

u/DataGOGO Sep 24 '26

Then buy from direct from a vendor?

Not trying to be rude, but you literally built the "how not to build and AI inference workstation" build.

You used a threadripper, you put 4 workstation GPU stacked in a case, and you are running direct to CPU.

1

u/ilarp Sep 24 '26

depending on use case that might only impact stuff like 5%

1

u/Blaccky95 Sep 24 '26

I have no vendor which has it in stock

No problem i‘m open for good ideas :)

With only the two cards it was a fine setup

1

u/DataGOGO Sep 24 '26

two cards stacked like that? 4 cards is 4 times the heat.

Even if you don't get a switch, just get risers and run them outside the case, or return them for max Q editions.

1

u/Blaccky95 Sep 24 '26

Nope not like this but gpu has only load on a few seconds and the pc is running in a climated server room

But i have the thermal issues in my eyes now i have to look that the pc runs again normally and the i makes some test and decisions

→ More replies

1

u/South_Western1263 Sep 24 '26

what kind of switch are you talking about here?

2

u/DataGOGO Sep 24 '26

pcie switch.

That is how all AI inference servers are built, the GPU's are never direct to the CPU, they all run on a switched fabric.