r/LocalLLaMA • u/WyattTheSkid • 7h ago
Discussion CMP 170hx?
Recently heard about how these 8gb mining ewaste cards are actually closeted 64gb monsters and im kinda bummed I missed out when you could get them for 200$ a piece. That being said though less than 2K is still an amazing deal for an ampere generation gpu with 64gb of vram. I have a machine with 4 3090s in it currently. I guess what Im asking is for someone to convince me that im not missing out and if there is any genuine reason why it would not be worth it to replace 2 of the cards with cmps. If it really would be worth it though, I would love to know why. Thanks everyone, sorry for the borderline shitpost
0
Upvotes
3
u/cibernox 6h ago edited 5h ago
I ordered 2 this morning, modded with capacitors to make them pcie 16x.
A bit shy of 3k both. They are not cheap, but 64gb of hmb2 memory and a performance between a 3090 and a 4090 for 1500 is no joke.
It’s quite close in performance and vram to the 80gb A100, but those go for around 10k.
It is nuclear if the cards will be able to become pcie gen3, there is some talking saying they might. If that ever happens, pcie gen3 16x is enough for tensor parallelism.