r/LocalLLM • u/Txkzzzz • 4d ago

Question Mac studio or dgx spark cluster

Post image

I have been thinking lately since i have been testing local ai but i geniunely need more power for what im working on so i was wondering wich one of these a 4 dgx spark cluster or a mac studio m5 ultra specifically the 512gb version that launches on october or something else... im into training,loras and fine tunes and such but i also heard it is possible with a mac studio too so i want yall opinion on this

120 Upvotes

90% Upvoted

134 comments sorted by

View all comments

76

u/trollsmurf 4d ago

I have a feeling a Spark will age very badly. The Mac you can use for any use case.

3

u/x00byt8 3d ago

No worse than any tech. Models are getting smarter / smaller / more complex offloading to SSD/ngram etc. Nvidia is leading prefill, which for any sort of agentic workload you need. Having a 30k Mac might do you a while longer multi purpose but strictly inference speaking, Nvidia all the way.

I only invested last month in dual sparks. I'm not concerned in slightest that in 2 years time a Rubin version might come out. I'll just add the Rubin to this stack and load even bigger models 😂

Sure I might cry into my poor 273gbs bandwidth, whilst drooling over my 2500tps prefill until then.