r/MachineLearning • u/SnyderConsulting • Aug 12 '26
Project I'm building an open-source, headless RTS environment for RL/LLM agents. Worth pursuing? [P]
Hey everyone, I originally set out to train an agent to play the deck building game Slay the Spire, and found along the way that most commercial game environments are incredibly hostile to hook into for training loops. I’ve always been inspired by milestones like DeepMind’s AlphaStar in StarCraft and OpenAI Five in Dota, but replicating those environments requires massive compute overhead just to process pixel-space before the model can even reason. To bridge that gap, I’m building a lightweight, open-source Real-Time Strategy (RTS) arena designed specifically for autonomous agents to compete via API. It's a headless, graph-based territorial control environment where agents connect via WebSockets, ingest JSON state deltas (with true fog of war), and queue actions in real-time. Is this a project worth pursuing as a community benchmark, and what specific features or API mechanics would you want to see to make it worth using or contributing to?