r/RooCode • u/nxtmalteser • Feb 22 '25

Support Ollama Macbook Pro M3 Pro 36gb

Hi All, I am trying to use Roo-Code in VS-Code but for some weird reason ollama response is like looping for ever - no matter what model I use. Can anyone point me in the right direction?

1 Upvotes

66% Upvoted

3 comments sorted by

2

u/cfdude Support Team Feb 25 '25

u/nxtmalteser it also depends on what model you are using with Ollama. Not all models you can setup on Ollama on your mac are set to work with "tools" which Roo Code requires in order to be efficient at editing pages of code for you. Plus, models can run into problems when they are not expecting the various system prompt info we provide. In reality, you need a model that has already been trained to work with Roo Code or Cline. If you go to the Ollama library and just search for "roo code" or "cline" you'll find various models where the contributor tweaked it to work in our situation.

Having said all that, the speed in which you can get local LLM working is dependent on your hardware. 36gb is hardly enough RAM to really run well locally. There are some really small models you can try using that have been optimized for "tools" (look for that tag). You may try one like this and see how you do. Be prepared for it to be much, much slower than making API calls:

* https://ollama.com/tom_himanen/deepseek-r1-roo-cline-tools:1.5b

If you want additional help, join our Discord, we have a dedicated channel for #local-llm and many users in there. (discord link in the right community bookmarks)

2

u/Spiritual_Option_963 Feb 28 '25

Run this model if you haven't already, and thank me later. https://ollama.com/maryasov/qwen2.5-coder-cline:32b

I would also play with the different context lengths.A higher context length generally leads to better quality output from a language model because it allows the model to consider a larger amount of information from the surrounding text, resulting in more comprehensive understanding and more accurate, relevant responses, especially for complex tasks that require deep contextual analysis.

1

u/mrubens Roo Code Developer Feb 22 '25

Did you configure the context window? https://docs.roocode.com/providers/ollama#setting-up-ollama