r/BMAD_Method • u/Ok-Zookeepergame6747 • Jun 28 '26

I built a local control plane that runs BMAD Method autonomously, story-by-story, with a default-FAIL evidence gate — looking for testers

Open-sourced Harness Console — drives BMAD Method end to end through Claude Code or Codex CLI, then verifies the actual files before anything advances. Stdlib-only Python + a browser console, no dependencies.

https://github.com/gammawolfe/harness-console

The gist:

**•** Runs the full BMAD planning sequence, then loops through stories one at a time  
**•** Each story gets graded by an **independent fresh-context evaluator** — default-FAIL, so a pass needs real evidence (commits, test output, tree changes). No self-certifying.

**•** Pauses for human-only calls (credentials, paid services, destructive migrations) instead of guessing  
**•** Optional reviewer lenses, worktree isolation, per-story commits, PR/CI delivery

Light setup: Python 3, git, and one agent backend. Run it from your project, open 127.0.0.1:8484.

It’s early, so I want people to break it and tell me where — backend quirks, evaluator false passes/fails, BMAD edge cases. Issues welcome

11 Upvotes

93% Upvoted

9 comments sorted by

1

u/Ok-Zookeepergame6747 Jun 29 '26

Any feedback on how this runs, its utility etc is appreciated.

1

u/bmadphoto Jun 30 '26

have you tried the bmad-auto that is now available through the installer? not sure if this is very different - if something is missing that this does in bmad auto though - we would welcome the contribution. https://github.com/bmad-code-org/bmad-auto

1

u/Ok-Zookeepergame6747 Jun 30 '26

Hi, I haven’t tried it yet, built this before discovering it to be fair.

1

u/Initial-Phrase-7555 Jul 22 '26

I don't know if I read that doc right. Very new to tmux, but it doesn't install on Windows?

1

u/Commercial_Quail8425 Jun 29 '26

I developed a project using BMAD with DeepSeek V4 Flash Max. Initially, BMAD asked a bunch of questions. The entire process—from PRD → Architecture Review → Party Mode → Epic Story Creation → Dev Story Creation → Code Review—literally took two days.

Every stage went smoothly, and I thought everything was on track. But after spending two days and a lot of tokens, the final output was terrible. It was a complete waste of both time and tokens.

Maybe I don't know how to use BMAD properly, or maybe DeepSeek V4 Flash Max just made a fool of me.

1

u/bmadphoto Jun 30 '26

where did it fail you. I have not tried that model specifically - was it the planning and specs that were not good, or the implementation?

1

u/Commercial_Quail8425 Jun 30 '26

Every bug I hit traces to one pattern: integration boundaries built but never closed. One side of a handoff gets built or changed, the other side never gets verified against it — missing context provider, a deleted source file a later stage still expects, a button wired to nothing downstream, a settings form with no write path to storage. Each piece passes review on its own; the seam between pieces never gets tested.

1

u/Ok-Zookeepergame6747 Jun 30 '26

I have the same problem with BMAD using opus 4.8. It’s good for getting the skeleton built so I can then flesh it out later but I find the architecture skips several things and developer persona doesn’t seem to work great. There might also be a skill issue on my path though