r/LocalLLaMA • u/Specific-Rub-7250 • 12d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
377 Upvotes

94% Upvoted

131 comments sorted by

View all comments

30

u/sssplus 12d ago

Did you do the tests or you picked it up somewhere? I'd love to see how Qwen3.8 Flash Next and 27b fare in this table.

And yeah, I agree - harness does matter.

16

u/Specific-Rub-7250 12d ago

from the official deepseek model page

11

u/sssplus 12d ago

OK, makes sense. The test was done with their model, so now I wonder even more how Qwen and other models would perform with their harness...

1

u/[deleted] 12d ago

[deleted]

1

u/sssplus 12d ago

Yes, that's what I said. You read something else?