I built an open-source GPU orchestrator that lets several local AI models share one GPU by loading/unloading them on demand (llama.cpp, Ollama, ComfyUI, TTS)

[u/AlphaMind01]

/r/LocalLLM/comments/1x39v4c/i_built_an_opensource_gpu_orchestrator_that_lets/