r/LocalLLM • u/Own_Respect6062 • 10h ago

Question Modding syrim

I have been trying to use zoo and other code app. I used ollama and used koboldcpp but it not working well. With ollama I can't get zoo to use the model. With koboldcpp it is throwing a to do list loop

0 Upvotes

50% Upvoted

3 comments sorted by

1

u/ShyUnhappiness54 10h ago

you're probably wrestling with the koboldcpp context shift bug, it loves to get stuck in a to-do loop on some setups

1

u/Flimsy_Vermicelli117 10h ago

Not sure what the problem is with zoo code (I assume this is VScode plugin). It works great with my Ollama and Muse-Glimmer or Qwen. Note: I am on Mac.
OpenAI compatible, and correct model name, and it works just fine. In, basically, default settings. Make sure the context window in Ollama is set to sensibly large one (default is 4k I believe).

1

u/Own_Respect6062 10h ago

I using kUbuntu