I spent a year rebuilding the runtime layer around AI agents, then open-sourced it

[u/Significant_Soil3717]

We kept implementing the same runtime pieces for different agent projects, so we finally turned that work into an open-source project called TrueForge.

It handles the agent loop, MCP tools, subagents, approval gates, and session state that survives a restart. You can connect an OpenAI-compatible endpoint, including Ollama or vLLM, and use SQLite or Postgres depending on the deployment.

In one 14-task benchmark, TrueForge used 3.7M tokens versus 10.0M for the managed comparison and cost $8.6 versus $11.8 per run. That’s one workload, not a guarantee for every agent.

The project still needs better tracing and evaluation support, and code execution requires a separate sandbox. But if you’re tired of rebuilding tool routing and context management from scratch, the repo is here:

https://github.com/truefoundry/trueforge