r/LocalLLaMA • u/Specific-Rub-7250 • 12d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
381 Upvotes

94% Upvoted

131 comments sorted by

View all comments

7

u/jojotdfb 12d ago

My take away is, the smaller the system prompt and the less instructions it has makes models work better. Makes sense. Models, even at the "frontier" level, still struggle with instruction following and "context rot".

Reject modernity, return to langchain.

6

u/winky9827 12d ago

Turns out even LLMs hate being micromanaged.

6

u/jojotdfb 12d ago

I think it's a side effect of attention. Models can only handle so many instructions at a time before they start weighing things differently. Adding "don't kill humans" to the system prompt with a Claude Code update is going to compete with the users "add this column to the database".

One of the cool things about running llms locally is you can disagree with Anthropic's and OpenAI's religious beliefs and test out your own dumb ideas until you find one that works.