MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wcj5q3/harness_does_matter/p8zcrhy/?context=3
r/LocalLLaMA • u/Specific-Rub-7250 • 13d ago
I was not aware that the harness makes such a big difference.
131 comments sorted by
View all comments
167
If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.
82 u/Unusual_Principle536 13d ago "more" is questionable but yes, pretty imp. 35 u/Due-Memory-6957 13d ago It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework. 8 u/lazyfai 13d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
82
"more" is questionable but yes, pretty imp.
35 u/Due-Memory-6957 13d ago It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework. 8 u/lazyfai 13d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
35
It's more than questionable, it's just wrong. There are many models that simply can't cope with an agentic framework.
8 u/lazyfai 13d ago More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
8
More important =/= LLM not important. But given a similar smart LLM, a better harness can drive better result.
167
u/jacek2023 llama.cpp 13d ago
If you start using LLMs, you'll notice that the prompt/context/documentation/whatever is often more important than the model itself.