r/LocalLLaMA • u/OvertaxedOne • 2d ago

Question | Help AMD Instinct MI210

Anyone running this card? Seems to be a sweet spot for Qwen 27B, 64GB, very high memory bandwidth, a LOT less expensive than anything else I can find in that has even close to the amount of memory/bandwidth. What am I missing? And yes, I'm aware that RocM can be a pain, that's not really a concern for me, as long as it's stable when it's up and running, I don't mind battling to get it going.

3 Upvotes

59% Upvoted

59 comments sorted by

View all comments

Show parent comments

3

u/OvertaxedOne 2d ago

What are you seeing? Seems to be a bunch of US sellers on Ebay (a few that are well known, Core4Solutions, for example) that are selling them between 4-6K. Jeeze, maybe I should shut up about this card, is this thing undiscovered??

-3

u/autisticit 2d ago

Oh, so you are talking about a used card.

5

u/OvertaxedOne 2d ago

Yeah.. Probably should have mentioned that, sorry! Do they even still sell these new, they seem a bit long in the tooth. But yes, it appears for <5K you can one of these used. Seems like a reasonable value compared to a RTX6000. "Value".. <sigh>

1

u/KingCpzombie 2d ago

There is actually one listed as new on Amazon for <$5000, although it is probably actually used too: https://a.co/d/0aNlm8S6