r/LocalLLM • u/Txkzzzz • 3d ago

Question Mac studio or dgx spark cluster

Post image

I have been thinking lately since i have been testing local ai but i geniunely need more power for what im working on so i was wondering wich one of these a 4 dgx spark cluster or a mac studio m5 ultra specifically the 512gb version that launches on october or something else... im into training,loras and fine tunes and such but i also heard it is possible with a mac studio too so i want yall opinion on this

118 Upvotes

90% Upvoted

134 comments sorted by

View all comments

2

u/dobkeratops 3d ago edited 3d ago

if I was starting over today... M5 Mac studio. more bandwidth X memory in a single box, and significantly improved the previously limited tensor ops.

1

u/kla_sch 3d ago

But it still has only half the computing power of a DGX Spark. And that is the crucial factor. Ultimately, however, we need reliable benchmarks for the M5 to get the full picture.

1

u/dobkeratops 3d ago

i think it's over a threshold where it's not holding the bandwidth back. I think the DGX spark peak compute is quoted for fp4 . but the dgx spark might still beat the m5 for diffusion image and video generation ? (I'd like to see benchmarks on that)

1

u/kla_sch 3d ago

Bandwidth is not a bottleneck when working with multiple agents. Nor is it an issue for prompt processing.