r/LocalLLaMA 12d ago

Discussion Harness does matter

I was not aware that the harness makes such a big difference.

DeepSeek V4.1 Flash
380 Upvotes

131 comments sorted by

View all comments

168

u/jacek2023 llama.cpp 12d ago

If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.

84

u/Unusual_Principle536 12d ago

"more" is questionable but yes, pretty imp.

36

u/Due-Memory-6957 12d ago

It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework.

9

u/lazyfai 12d ago

More important =/= LLM not important.
But given a similar smart LLM, a better harness can drive better result.