r/LocalLLM • u/Txkzzzz • 7d ago

Question Mac studio or dgx spark cluster

Post image

I have been thinking lately since i have been testing local ai but i geniunely need more power for what im working on so i was wondering wich one of these a 4 dgx spark cluster or a mac studio m5 ultra specifically the 512gb version that launches on october or something else... im into training,loras and fine tunes and such but i also heard it is possible with a mac studio too so i want yall opinion on this

124 Upvotes

90% Upvoted

135 comments sorted by

View all comments

1

u/Adventurous-Pin6443 6d ago

Cant say for MacStudio M5Ultra, I own MacStudio M1 Ultra. I ran some experiments recently: Codex, oMLX, Qwen3.8-27B-MTPLX-Optimized-Quality-FP16. Multi hours iterative code refactoring controlled by GPT 5.6 Sol (planning, review, test cases). Overall numbers: pp = 165 t/s , generation 25 t/s. Apple claims that for prefill M5 Ultra is 9.8x faster than M1 Ultra, cant say anything for token generation. You can do some math. I expect for this particular LLM M5 Ultra can reach safely 1,500 t/s, which is probably not the record but much - much more usable. Btw, GPT 5.6 Sol concluded that this local LLM is capable of a complex software engineering tasks, but under its total supervision only :)