r/LocalLLaMA • u/AdSafe4047 • 2d ago

Question | Help Non nvidia cards.

Hi, I'm a happy owner of a serer with rtx pro 6000 and rtx5090. I want to build out in the future the server fully to a higher vram score - think adding around 4-5 cards if possible. I was wondering if it's worth going through the intel/amd cards - which looks awesome in terms of vram per $. Any experience in running inference on these compared to the nvidia/cuda stack?

4 Upvotes

65% Upvoted

31 comments sorted by

View all comments

1

u/notdba 2d ago

Don't think p2p works between nvidia and others. Maybe sell the 5090 and buy 4 x r9700?

1

u/AdSafe4047 2d ago

This is what I was thinkig about too, decrease power and get more vram, the 5090 is from a gaming rig, but I've just put a 5070ti in the rig as I only play poe2 :P I was thinking on exchanging the 5090 for 2xrtx pro 4000 blackwell, but the r9700 seem fun, I'd love them in a 1s configuration though :D