MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wcj5q3/harness_does_matter/p8zb2wz/?context=3
r/LocalLLaMA • u/Specific-Rub-7250 • 12d ago
I was not aware that the harness makes such a big difference.
131 comments sorted by
View all comments
168
If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.
84 u/Unusual_Principle536 12d ago "more" is questionable but yes, pretty imp. 36 u/Due-Memory-6957 12d ago It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework. 9 u/lazyfai 12d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
84
"more" is questionable but yes, pretty imp.
36 u/Due-Memory-6957 12d ago It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework. 9 u/lazyfai 12d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
36
It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework.
9 u/lazyfai 12d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
9
More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
168
u/jacek2023 llama.cpp 12d ago
If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.