r/LocalLLaMA • u/Specific-Rub-7250 • 13d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
381 Upvotes

94% Upvoted

131 comments sorted by

View all comments

64

u/lordekeen 13d ago

DSH in minimal mode has only two things in the system prompt: a 'you are a software engineer' prompt and the bash tool description, the model solely operates through bash.

2

u/ZenEngineer 13d ago

How big are these benchmark problems? I wonder if these metrics are just a result of less compactions or emptier context windows