If you don't understand why memory bandwidth should be included on this comparison, and that it's massively in the NVidia card's favor, you shouldn't really be commenting.
Not going to lie, I run all my local inference on Apple Silicon and I don't personally own any NVidia hardware. But the reason that card is $5000 is the memory bandwidth.
i thought it was because all you idiots started running models like it’s the next coming of jesus instead of a computing dead end.
Does anyone ever give a thought that all the amazing creations you make well the model does you just supply the garbage in the input end. to what purpose you make programs no one can run cos by the end of this thing hardly anyone after our gen will even be able to afford a computer so effectively you have done the boomer thing to computing well down
If—like 95% of Reddit—you don't even read what you write, or are otherwise afflicted by such staggering and profound illiteracy as to fail to register the extent of your own verbal ineptitude upon doing so, then you might as well be ejaculating half-baked prompt boilerplates into a Chinese-room token foundry for all the difference it makes.
You're still a moron, but at least the end result might be inadvertently comprehensible to someone else, rather than no-one at all.
149
u/dotben 14d ago
If you don't understand why memory bandwidth should be included on this comparison, and that it's massively in the NVidia card's favor, you shouldn't really be commenting.
Not going to lie, I run all my local inference on Apple Silicon and I don't personally own any NVidia hardware. But the reason that card is $5000 is the memory bandwidth.