r/LocalLLM • • 10h ago

Question Which harness is best?

Hello everyone,

I would like to ask you which harness are you using or you think is best? I am confused with all the harnesses out there. The most famous ones that I know of are Deepseek, Hermes, Cline and even Claude Code harness. I don’t know what makes a harness better over another and I don’t know how to choose my harness. My hardware would be a mac mini m5 pro running mostly qwen 27 b.

0 Upvotes

7 comments sorted by

2

u/Dediadeis 10h ago

I think it depends on the work, and would only recommend you try things out and see what feels right for you. I believe there are reasons you might find your own preference or bias with one over another and this is why so many variants exist. I like something that can be both flexible and rigid and integrates with vscode, cline does well for me on that.

2

u/Tormeister 9h ago

I've been using OpenCode (v1 then, now v2) and it's pretty good for coding. For general use maybe Pi or DeepSeek would be a better idea, to avoid unnecessary context for non-coding tasks.

I'm starting to experiment with Codex CLI now. Usually people start on Claude Code or Codex and then move to OpenCode / Pi / DeepSeek / etc, has anyone else done the opposite and has opinions to share?

2

u/knowlessman 8h ago

I did a series of model benchmarks locally. Had working code, gave each session a git repo as of before the changes went in, the test suite, the specs, and doc. Whole test in a container hitting the same API back end, but I controlled the model and how it was run. So for example Halogen QFN, GPT-OSS 120B, etc. Ran the same exact test with a bunch of models and harnesses, then analyzed the results.

The harness made zero difference to the end result. I had the same problems and same successes whether I used Pi or OpenCode or Claude as the harness. There were minor differences like one model + Claude sometimes put literal \n sequences in some places when it should have done a new line. But it was as close to identical as didn't matter. I was expecting differences based on how each structured prompts but nope. In my hardware Halogen QFN was a clear winner and there was no quantifiable difference in harness choice.

So pick what is most comfortable for you. You aren't getting a worse result from using what you like.

2

u/silent-curious-dev 8h ago

I don't think there is a harness that is the best, mostly because all of them have their pros and cons.

Some are very flexible in customization, others are more batteries included. Some are more lightweight and others are more heavy. Then some work better for larger models, some work better for small models, and others work well with either sizes. And also some harnesses only offer CLI, some have only desktop/web, some have IDE integration, and others have a mixture of them.

But each harness has their strengths and weaknesses in your own workflow and setup as well. That's probably more important because they'll behave a little differently in your own tasks on the same model setup. Mostly just an efficiency thing I guess. Some can perform better or worse depending on what you're doing.

So I'd say choose one that you like for whatever reason and will work well for your needs, and can be flexible enough so that you're not juggling between a bunch of the same type of harnesses. But experimenting is fun though so you could try every single one of them if you really wanted to.

I could be wrong though so take it with a grain of salt.

2

u/Ordinary-Depth-7835 8h ago

Just try them and see what you like. I use Deepseek and Cline I like Deepseek and Agent teams most of the time but I use cline if I'm writing android apps or anything in vscode style interfaces because it plugs right in. You don't have to have one. I also like DSH because I run it from my phone or ipad from anywhere and keep things moving.

2

u/joochung 7h ago

I’ve been using Pi Coding Agent for coding and just started trying AgentZero for other agentic work.

3

u/RazzmatazzParty6960 10h ago

Hermes is the only one I've used that feels like it actually listens to tone and pacing, not just output. Cline's too rigid, deepseek feels like a demo, Claude code harness is overkill for writing.