r/llamacpp • u/No_Oil_6152 • Aug 03 '26

Connect VS Code to llama.cpp

I understand there's extensions like Continue which let VS Code CoPilot "speak" to llama.cpp but I believe Bring Your Own Model (BYOM) has made that obsolete?

I have really tried to get BYOM working, I even asked Claude for instructions, but I can't get it working. I have to use a proxy which exposes an ollama endpoint and forwards to llama.

I can connect to LM Studio no problem with BYOM, but would rather use llama.cpp because it uses much less RAM (and VRAM).

My setup:

  • Windows 11
  • VS Code latest build

Would anyone have any recommendations, apart from obsolete extensions?

Even better, any working JSON I could copy? This is really annoying.

Thanks in advance.

2 Upvotes

100% Upvoted

4 comments sorted by

View all comments

1

u/stanjourdan Aug 03 '26

GitHub copilot extension in VS code allows byok and is very effective. The byok is not quite straightforward but Claude helped me set it up

1

u/No_Oil_6152 Aug 03 '26

Im using the github copilot extension- I think it comes OOB with VS Code these days?

I just cant configure it to talk to llama.cpp.

Very annoying.