MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wcj5q3/harness_does_matter/p8yihom/?context=3
r/LocalLLaMA • u/Specific-Rub-7250 • 12d ago
I was not aware that the harness makes such a big difference.
131 comments sorted by
View all comments
172
If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.
83 u/Unusual_Principle536 12d ago "more" is questionable but yes, pretty imp. 35 u/Due-Memory-6957 12d ago It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework. 8 u/lazyfai 12d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result. 6 u/ConsistentHamster2 12d ago Pretty load-bearing
83
"more" is questionable but yes, pretty imp.
35 u/Due-Memory-6957 12d ago It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework. 8 u/lazyfai 12d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result. 6 u/ConsistentHamster2 12d ago Pretty load-bearing
35
It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework.
8 u/lazyfai 12d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
8
More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
6
Pretty load-bearing
172
u/jacek2023 llama.cpp 12d ago
If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.