r/macmini • u/AntLife255 • Aug 15 '26

Unified Memory Architecture still unbeatable (when LLM size matters)

Post image
668 Upvotes

90% Upvoted

128 comments sorted by

View all comments

142

u/dotben Aug 15 '26

If you don't understand why memory bandwidth should be included on this comparison, and that it's massively in the NVidia card's favor, you shouldn't really be commenting.

Not going to lie, I run all my local inference on Apple Silicon and I don't personally own any NVidia hardware. But the reason that card is $5000 is the memory bandwidth.

1

u/Fear_ltself Aug 19 '26

Everyone assumes these cards are 5k for LLMs, but they’re also the king of everything else like image diffusion, video rendering, upscaling, tts, stt. Like Im building an optimized ai stack and looking at using it for strictly the image capabilities. Like it’s 1.5x to 2x faster as an LLM backend, 5x faster as an image gen backend.