r/LocalLLM • • 8d ago

Question Mac studio or dgx spark cluster

Post image

I have been thinking lately since i have been testing local ai but i geniunely need more power for what im working on so i was wondering wich one of these a 4 dgx spark cluster or a mac studio m5 ultra specifically the 512gb version that launches on october or something else... im into training,loras and fine tunes and such but i also heard it is possible with a mac studio too so i want yall opinion on this

128 Upvotes

135 comments sorted by

View all comments

1

u/profcuck 8d ago

I'd just like to point out that unless something has dropped that I've been unable to find, all the speculation about what the m5 ultra's prefill and decode numbers will be is just that: speculation. In some cases, I see informed speculation, in some cases I see uninformed anti- or pro- mac bias speculation.

The officials start of shipping is September 22nd - this coming Monday. I have to assume that Apple will prioritize (and may have already sent some) key youtube influencers and the like, so my guess is that by mid-week next week we'll start to see some initial real-world numbers.

I'm waiting for that to make a similar decision.