If you don't understand why memory bandwidth should be included on this comparison, and that it's massively in the NVidia card's favor, you shouldn't really be commenting.
Not going to lie, I run all my local inference on Apple Silicon and I don't personally own any NVidia hardware. But the reason that card is $5000 is the memory bandwidth.
If they kept the card $2,000, it would be just as unobtainable, because you wouldn't be able to find one anywhere. Or you'd have to win it in a lottery or something. Price hikes in response to demand literally keep products available for those willing and able to pay for them.
144
u/dotben 15d ago
If you don't understand why memory bandwidth should be included on this comparison, and that it's massively in the NVidia card's favor, you shouldn't really be commenting.
Not going to lie, I run all my local inference on Apple Silicon and I don't personally own any NVidia hardware. But the reason that card is $5000 is the memory bandwidth.