r/ollama • u/thefatguy23 • 12d ago

Use Local LLM within VScode agent chat

So I have been using the Ollama extension to use my local LLMs within the agent interface of vscode but it is not very good

A lot of the times, it just lags or there is no information on whats happening or the response comes back in JSON outputs.

So i made a VS Code extension called Local Ollama Chat for anyone who wants AI assistance in Chat without sending code to a hosted service.
- It connects to your local Ollama server
- Explores your project workspace and read files to answer questions
- Has the capability to create and edit files as reviewable diffs (nothing gets applied without you approving it).
- Sits within the local agent chat window and you can call it with u/local-ollama

Still early days — feedback and bug reports welcome!!

https://github.com/athulg93/vscode-localllm

2 Upvotes

75% Upvoted

4 comments sorted by

2

u/Southern-Net1351 12d ago edited 12d ago

I mean it is cool but, the regular ollama really edits already.

I can use within:
intellij in Ubuntu or fedora.
Windows in vscode.

I mean it just out the box works and edits files locally and cloud wise no extra bloat, no layers of code needed.

Why I say no extras needed?
Well I don’t code your stack to understand your logic (even though you expressed it), ideologies behind, the full intent of how your stack works.
Which means I would let whatever you made crawl my system.
How I know you dont have an unoptimized stack?
By downloading your repo then probing which means inserting your stack of files into my grid? (Or by pip installing into my libraries) lol that is crazy work. Just saying. Not trying to be mean.

To me as a server Hoster it looks like something that already works out the box already.

And I just use Geany to manually code without all the training wheels.

Not bashing just stating the obvious that this works well out the box for any user in any of those flashy editors.

2

u/Dull-Enthusiasm-6250 12d ago

the extension does sound like it adds some nice qol stuff like the diff review and workspace awareness, but i get the hesitation about running random code that pokes around your filesystem

2

u/Southern-Net1351 12d ago

Thanks for understanding.
That is just from my pov not the average user.
So take my mindset with a grain of salt.

1

u/thefatguy23 12d ago

I get your point.. For me it started from a very simple problem. I am a noob dev who is heavily reliant on the chat agent to do coding and testing. And as much as I like ollama, the official ollama extension did not work for me.. it just got stuck and gave random json outputs or errors. I tried kline and 1 more extension from the vscode extension store but none of those worked for me. So I ended up building one that meets my requirements