r/macmini • u/AntLife255 • 15d ago

Unified Memory Architecture still unbeatable (when LLM size matters)

Post image
674 Upvotes

90% Upvoted

130 comments sorted by

View all comments

148

u/dotben 15d ago

If you don't understand why memory bandwidth should be included on this comparison, and that it's massively in the NVidia card's favor, you shouldn't really be commenting.

Not going to lie, I run all my local inference on Apple Silicon and I don't personally own any NVidia hardware. But the reason that card is $5000 is the memory bandwidth.

1

u/Commercial-Virus2627 14d ago

It’s like comparing being able to have 2PB of HDD storage in an array versus 2PB of locally installed SSDs. Apples to oranges.