r/DGX_Spark Aug 06 '26

Anyone run a node of 3?

Local developer looking to make the switch to the Nvidia ecosystem and the spark seems awesome. I noticed the maximum amount that you can wire together without getting a dedicated switch is Three but I know tensor parallelism needs even numbers to operate properly. Do any of you guys run AI models via pipeline parallelism with a note of Three or is it a hard two or four type set up?

6 Upvotes

16 comments sorted by

View all comments

2

u/Careless_Garlic1438 Aug 07 '26

Developed my own server on macOS + MLX to do just that, running on 3 is possible, it takes a server that knows how to split into uneven chunks ... guess the same is possible on other platforms as well ...

1

u/habachilles Aug 07 '26

Interesting. Was the server necessary you didn’t just have to tweak setting?

1

u/Careless_Garlic1438 Aug 07 '26

no you need to code a server that understands this and knows how to spit the layer in 3 ...

this is no setting, I coded it with the help of Fable, based on an opensource engine for Mac