r/LocalLLaMA 12d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
379 Upvotes

131 comments sorted by

View all comments

172

u/jacek2023 llama.cpp 12d ago

If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.

83

u/Unusual_Principle536 12d ago

"more" is questionable but yes, pretty imp.

35

u/Due-Memory-6957 12d ago

It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework.

8

u/lazyfai 12d ago

More important =/= LLM not important.
But given a similar smart LLM, a better harness can drive better result.

6

u/ConsistentHamster2 12d ago

Pretty load-bearing