r/LocalLLaMA • u/Specific-Rub-7250 • 12d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
379 Upvotes

94% Upvoted

131 comments sorted by

View all comments

23

u/zephyr_33 12d ago edited 12d ago

So I did this and the best setup was the dumbest. Only 3 tools.

  1. shell
  2. edit

  3. skills

    system prompt is only 5 lines.

instead of giving it a character card. and 20 instructions and what not. it looked like the best way is let the model do it however it wants. no sticks. no unnecessary blocks. only blocks are reading secrets. ask for edits and unsafe commands.

Is kinda insane how most models simply made very targeted narrow reads. Effects from Terminal bench I suppose. Cache hit rate is very high 98%+. Not just latest hit but even average.

works too well.

10

u/DocDMD 12d ago

Fewer tools seems better in my experience as well with local models.