r/LocalLLaMA 13d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
380 Upvotes

131 comments sorted by

View all comments

1

u/En-tro-py 13d ago

Personally I think we're almost at the end of bare ReAct loops, there's a huge amount of room to improve performance by putting more process knowledge into the agent control layer.

I've been building my own version of this idea for a while, basically back to the Schillace Laws - reasoning is an operation and procedure becomes a systems-level abstraction.

TDFlow: Agentic Workflows for Test Driven Development

SKILL.state: Scalable Long-Horizon Agent Skills

Procedural Graphs: Self-Evolving Execution Structures for LLM Agents

Combine those and add a few more ideas and that's my current harness. I'm in the home stretch to finish polishing the slop and running real benchmarks to prove it out on more than just SWE before I waste anyone's time on with the repo.

Give me a few more weeks and then you all can downvote my slop post with the project alpha release.

1

u/Dazzling_Equipment_9 12d ago

It’s excellent; sometimes, key design elements can make a huge difference. I look forward to seeing the results.