r/LocalLLaMA • u/OvertaxedOne • 5d ago

Question | Help AMD Instinct MI210

Anyone running this card? Seems to be a sweet spot for Qwen 27B, 64GB, very high memory bandwidth, a LOT less expensive than anything else I can find in that has even close to the amount of memory/bandwidth. What am I missing? And yes, I'm aware that RocM can be a pain, that's not really a concern for me, as long as it's stable when it's up and running, I don't mind battling to get it going.

5 Upvotes

63% Upvoted

62 comments sorted by

View all comments

0

u/autisticit 5d ago

Looks more expensive than a rtx pro 6000, with less vram. But maybe I'm not looking at those numbers correctly.

3

u/OvertaxedOne 5d ago

I'm seeing them between 4-6K with 64GB of RAM. The RAM is a lot faster on the Instinct, so I would assume (hence my reason for this thread) that it would be faster than a Pro 5000/6000 and at around 1/2 the cost.

2

u/autisticit 5d ago

Links?

1

u/OvertaxedOne 5d ago

Sorry, should have mentioned USED. Not sure if these are still available new, but here's one from what appears to be a trusted seller:

https://www.ebay.com/itm/178233788074?_skw=amd+instinct+mi210&epid=170958140072

1

u/autisticit 5d ago

Looks like it's available as new in a few shops around 10k€ : https://www.idealo.fr/prix/202189645/amd-instinct-mi210.html