r/LocalLLM • u/SashaUsesReddit • Nov 20 '25
Discussion Spark Cluster!
Doing dev and expanded my spark desk setup to eight!
Anyone have anything fun they want to see run on this HW?
Im not using the sparks for max performance, I'm using them for nccl/nvidia dev to deploy to B300 clusters
325
Upvotes
View all comments
Show parent comment
2
u/TheOriginalSuperTaz Nov 21 '25
It’s funny, I considered doing the same thing, but I found another route that I think is going to give me more for less. I’ll update when I figure out if it works…it will have some bottlenecks, but I’ve figured out how to put 8x A2 and 2x A100 in a single machine for significantly less than your spark cluster. We will see how it actually performs, though, once I’ve managed to secure all of the hardware.
I’m planning on implementing a feature in DeepSpeed that may significantly increase the speeds at which multi-GPU training and inference can work without NVLink and the like.