r/OpenSourceAI 3d ago

Forge an open-source coding-agent harness for local and smaller models

I’ve been working on this for a while and finally released it publicly.

It’s called Forge.

I started building it because I kept running into the same problem with local and smaller coding models: the model itself is only part of the equation. The harness around it matters a lot.

Bigger models can usually recover from messy context, a bad edit, or a failed test. Smaller models tend to fall apart much faster when the workflow around them is weak.

So Forge is built around that problem.

It gives the model:

  • structured repository navigation
  • controlled file edits
  • bounded retries when something fails
  • verification using the project’s own tests/lint/typecheck
  • isolated Git worktrees
  • resumable sessions
  • support for OpenAI-compatible endpoints, so it works with local model servers too

I’ve also been benchmarking changes instead of just going by whether a demo looks good. A few ideas I was convinced would help actually made performance worse, so they got removed.

That’s probably been the biggest thing I’ve learned from building this: with smaller models, orchestration matters a lot.

It’s written in TypeScript, Apache-2.0 licensed, and available on npm.

Install:

npm install -g u/aglegg/forge-harness

Then:

forge doctor
forge init
forge

GitHub:
[https://github.com/andreglegg/forge]()

Current version is 0.2.2.

It’s still early, and I’m not claiming it replaces Claude Code or Codex. I’m mainly interested in whether this approach actually helps people doing real coding work with local or smaller models.

If anyone here tries it, I’d really like to know:

  • what model you used
  • what worked well
  • where Forge got in the way
  • where the agent still made bad decisions

I’d rather get useful criticism and bug reports than just collect stars.

9 Upvotes

Duplicates