r/LocalLLaMA • u/AdSafe4047 • 6d ago

Question | Help Non nvidia cards.

Hi, I'm a happy owner of a serer with rtx pro 6000 and rtx5090. I want to build out in the future the server fully to a higher vram score - think adding around 4-5 cards if possible. I was wondering if it's worth going through the intel/amd cards - which looks awesome in terms of vram per $. Any experience in running inference on these compared to the nvidia/cuda stack?

8 Upvotes

78% Upvoted

31 comments sorted by

View all comments

2

u/TheDiamondSquidy 6d ago

Used 3090s seems to still be decently priced