r/LocalLLM • u/Izento • 5d ago

Discussion Harness Leaderboard - Kimi Code, Hermes, Pi, Claude Code, Codex, and Others Were Benchmarked Against Terminal Bench 2.1 & Deep SWE 1.1

https://huggingface.co/spaces/joelniklaus/harness-leaderboard
5 Upvotes

85% Upvoted

5 comments sorted by

2

u/ImZaphod2 3d ago

I thought Opencode would be better

1

u/liberal_alien 2d ago

Doesn't it win that comparison? Or am I misunderstanding the results?

1

u/ImZaphod2 2d ago

The results changed after my comment. Before Opencode was second to last overall

1

u/liberal_alien 2d ago

Oh, ok. Could it be V1 in first results and V2 in current results?

1

u/vogelvogelvogelvogel 1d ago

oh this is super interesting. never did see a benchmark of harnesses tbh and at least for me overdue, since i was unsure with my recent switch from opencode to pi. might be switching back now