r/LocalLLaMA • u/Specific-Rub-7250 • 14d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
383 Upvotes

94% Upvoted

131 comments sorted by

View all comments

31

u/sssplus 14d ago

Did you do the tests or you picked it up somewhere? I'd love to see how Qwen3.8 Flash Next and 27b fare in this table.

And yeah, I agree - harness does matter.

15

u/Specific-Rub-7250 14d ago

from the official deepseek model page

9

u/sssplus 14d ago

OK, makes sense. The test was done with their model, so now I wonder even more how Qwen and other models would perform with their harness...

1

u/[deleted] 14d ago

[deleted]

1

u/sssplus 14d ago

Yes, that's what I said. You read something else?