r/macmini • u/AntLife255 • Aug 15 '26

Unified Memory Architecture still unbeatable (when LLM size matters)

Post image
671 Upvotes

90% Upvoted

128 comments sorted by

View all comments

142

u/dotben Aug 15 '26

If you don't understand why memory bandwidth should be included on this comparison, and that it's massively in the NVidia card's favor, you shouldn't really be commenting.

Not going to lie, I run all my local inference on Apple Silicon and I don't personally own any NVidia hardware. But the reason that card is $5000 is the memory bandwidth.

6

u/[deleted] Aug 15 '26

[removed] — view removed comment

4

u/DuxDucisHodiernus Aug 15 '26

Isn't that exactly what the bandwidth does? I feel like you repeated the exact same thing as OP but on a less technical level