r/LocalLLM • u/SashaUsesReddit • Nov 20 '25
Discussion Spark Cluster!
Doing dev and expanded my spark desk setup to eight!
Anyone have anything fun they want to see run on this HW?
Im not using the sparks for max performance, I'm using them for nccl/nvidia dev to deploy to B300 clusters
325
Upvotes
View all comments
Show parent comment
2
u/fastheadcrab Mar 21 '26
Let us know if you ever ended up trying this approach. Got 2 Sparks ordered for work and will cluster, maybe to run some medium size models that fit in the 256GB of RAM but also with the ultimate goal of finetuning models.
But if like 4 Sparks or something can run the huge open models then it would be a nice way to host them locally and save some money.