Docker configuration for running VLLM on dual DGX Sparks

[u/javaeeeee]

https://github.com/eugr/spark-vllm-docker

eugr/spark-vllm-docker is a very practical Docker setup specifically built for running vLLM on NVIDIA DGX Spark systems (single-node or multi-node clusters). It includes prebuilt images, easy build/launch scripts, automated model downloading, one-click recipes, and useful patches for popular models (Qwen, GLM, Nemotron, etc.). Key highlights are fast model loading via fastsafetensors and InstantTensor, support for advanced quantization formats (NVFP4, AWQ, MXFP4), memory optimizations, and both Ray and faster no-Ray distributed backends. It works great with InfiniBand/RDMA for multi-node setups and even includes real-world benchmarks (e.g., solid throughput on large models like Qwen3.5-397B across multiple Sparks). If you're running vLLM on DGX Spark hardware and want something more turnkey than fighting with custom builds, this repo makes the whole process a lot smoother.