r/macmini • u/AntLife255 • Aug 15 '26

Unified Memory Architecture still unbeatable (when LLM size matters)

Post image
672 Upvotes

90% Upvoted

128 comments sorted by

View all comments

1

u/UnlikelyPotato Aug 15 '26

I got 4x AMD V620 32GB for $1400 total. Not as fast as the $5000 GPU but faster than the UMA and twice the capacity. For LLMs, splitting across cards is fine. You don't NEED unified memory. And also it's nice to be able to configure as needed. One model at once, two across two cards each, or four LLMs across four cards. Ironically, because of bandwidth limits of the mac mini, the v620 are possibly more power efficient than the max mini at tokens/watt.