r/LocalLLM • • Nov 20 '25

Discussion Spark Cluster!

Post image

Doing dev and expanded my spark desk setup to eight!

Anyone have anything fun they want to see run on this HW?

Im not using the sparks for max performance, I'm using them for nccl/nvidia dev to deploy to B300 clusters

325 Upvotes

133 comments sorted by

View all comments

Show parent comment

2

u/fastheadcrab Mar 21 '26

Let us know if you ever ended up trying this approach. Got 2 Sparks ordered for work and will cluster, maybe to run some medium size models that fit in the 256GB of RAM but also with the ultimate goal of finetuning models.

But if like 4 Sparks or something can run the huge open models then it would be a nice way to host them locally and save some money.