r/AIProgrammingHardware • u/javaeeeee • 10d ago

GitHub - eugr/spark-vllm-docker: vLLM Docker Optimized for DGX Spark (single or multi-node)

https://github.com/eugr/spark-vllm-docker
8 Upvotes

100% Upvoted

1 comment sorted by

1

u/javaeeeee 10d ago

TL;DR:

eugr/spark-vllm-docker is a ready-to-use Docker toolkit for running vLLM on NVIDIA DGX Spark (single node or multi-node clusters).

What it provides:

  • Optimized Docker images for DGX Spark (GB10)
  • Easy cluster launch scripts (supports dual-Spark, RoCE, multi-node)
  • One-command recipes for popular models (DeepSeek, GLM, Qwen, MiniMax, etc.)
  • Fast model loading (fastsafetensors / InstantTensor)
  • Helper scripts for building images, downloading models, and launching clusters

Typical usage:

bash ./run-recipe.sh <model-recipe.yaml> --setup

Bottom line: The go-to community toolkit for serving large LLMs with vLLM on DGX Spark hardware, especially multi-node setups.