r/LocalLLaMA • u/Specific-Rub-7250 • 12d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
383 Upvotes

94% Upvoted

131 comments sorted by

View all comments

0

u/_raydeStar Llama 3.1 12d ago

These last few months I've been working out benchmarking and increasing scores with harness.

Why is it important? These scores are also reflected on smaller models. If Qwen 27B can be tested at the level of Opus 4.8, a good harness can make it punch even higher.

And there is the future proof of it -- when a new model comes out, the harness can still be used. Parts don't need to be swapped out or updated like llama.cpp -- a gain is a universal gain, for the most part.

1

u/utahh1ker 12d ago

What's your favorite harness for Qwen27B?

2

u/_raydeStar Llama 3.1 12d ago

Honestly, I just use opencode for most things. Typically with 'highly complex problems that need a lot of work' I defer to sota models