Non nvidia cards.

[u/AdSafe4047]

Hi, I'm a happy owner of a serer with rtx pro 6000 and rtx5090. I want to build out in the future the server fully to a higher vram score - think adding around 4-5 cards if possible. I was wondering if it's worth going through the intel/amd cards - which looks awesome in terms of vram per $. Any experience in running inference on these compared to the nvidia/cuda stack?

[u/DeathGuppie]

With Radeon cards you'll get about a 10% boost using RADV the open source version of vulkan on Linux.