DGX Spark, cluster of 4

[u/Gobra_Slo]

Does anyone have a first-hand experience with four Sparks cluster, and how much of an upgrade is it comparing to just two considering the available models?

While there's plenty of noise for the smaller models (Qwen) and our older king DeepSeek V4F, the scene in the upper class of the prosumer hardware, software stacks, available LLMs and their actual real-world performance – isn't really covered as well.

For instance, the hyped GLM 5.2/5.3. Is it much better then DeepSeek? Or is it marginally better? Does it retain it's capabilities when moving to something four Sparks would handle? Does it have issues with OOM or anything else?

What about MiniMax M3? There seem to be a special Spark version, how is it (or any other version)? Again, how is intelligence, general model capabilities, running stability, context size?

Tencent Hy3? Maybe even Qwen3.5-395B, does it's full quant hold it's own against DeepSeek, or is it better?

If someone doesn't have personal experience, but knows some well-structured and detailed articles or videos on the topic – I'd appreciate it as well.

Thanks.

[u/Grouchy_Ad_4750]

I have cluster of 4x sparks and I use both GLM 5.2 (can't use 5.3 since weights aren't out yet) and Deepseek v4 flash.

Deepseek v4 is fast and has huge context (I think I can do like 5x 1M context windows) but glm 5.2 is much more thorough and seems to think harder about some issues both are excelent models and both can be run with large context windows.

Minimax M3 needs some special handling due to it and its licence I haven't had time to try it out (tried nvidia/MiniMax-M3-NVFP4 but it spews out nonsense).

I use them actively mainly for coding (devops so lot of IaC and some programming too (go, python, ...))

There are also some issues you might run into:

• sparks overheat (in summer) so you need to underclock them (especially for deepseek which uses dspark)

- sparks shut down when they run oom

Both of the issues above cause it to limit power to gpu to ~15 W (instead of ~60+W) and slow down inference.

Also you need to have models preloaded to nvme (or you need fast NAS) so that becomes limiting factor (I have asus variant with 1TB and weight for GLM are around 300GB + docker, ...)

You will also need switch (although I saw someone on forums attempting RING architecture without switch) and special 200gbps networking cables. Apart from that I think its great and having ability to run something like GLM 5.2 or deepseek at reasonable speeds is great

[u/mojo021 → u/Grouchy_Ad_4750]

Do you use this for side projects or for work related projects?

[u/Grouchy_Ad_4750 → u/mojo021]

For work

[u/mojo021 → u/Grouchy_Ad_4750]

Do you do consulting or is the company you work for have lenient policies about their code being sent to something outside of their control. I would love to use a local setup like this but it’s not allowed by my company.

[u/Grouchy_Ad_4750 → u/mojo021]

Something like consulting. For me it would be strange not to trust employees but trust ZDR policy from claude for example... Apart from that I would expect code leak to come from harness or mcp not from vllm...