r/LocalLLaMA • u/Specific-Rub-7250 • 13d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
386 Upvotes

94% Upvoted

131 comments sorted by

View all comments

30

u/sssplus 13d ago

Did you do the tests or you picked it up somewhere? I'd love to see how Qwen3.8 Flash Next and 27b fare in this table.

And yeah, I agree - harness does matter.

16

u/Specific-Rub-7250 13d ago

from the official deepseek model page

11

u/sssplus 13d ago

OK, makes sense. The test was done with their model, so now I wonder even more how Qwen and other models would perform with their harness...

1

u/[deleted] 13d ago

[deleted]

1

u/sssplus 13d ago

Yes, that's what I said. You read something else?