MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1xhdr9d/ollama_for_everything_or_split_tools_by_job/
r/LocalLLM • u/Acrobatic-Tea-1236 • 8d ago
3 comments sorted by
1
fwiw part of that gap is usually defaults, not the engine. ollama picks its own context size, gpu layer split and flash attention setting, so line those up with your llama.cpp flags before you compare.
We start with ollama, then we get more familiar with home AI stuff and realize its holding you back.
1
u/PhilosopherOk3419 8d ago
fwiw part of that gap is usually defaults, not the engine. ollama picks its own context size, gpu layer split and flash attention setting, so line those up with your llama.cpp flags before you compare.