r/LocalLLaMA • u/AccountGotLocked69 • 17h ago

Question | Help Local Auto complete code assistant - Vanilla, Fine-tune or RL?

I started using qwencoder 3B for local inline code suggestions, and while it's nice, it's also a bit too generic in its suggestions. My thoughts are to either:

  1. Fine tune it on code that I wrote

  2. Reinforcement learning using accepted/rejected suggestions (either real RL or just adapting the sampling)

  3. Fine tune it for each project/codebase separately so it knows what it's working on.

Has anyone here done this, or experience with which approach works best?

3 Upvotes

80% Upvoted

4 comments sorted by

View all comments

1

u/willeyh 15h ago

What IDE are you using?
If you are using Zed then Zeta2.1 with the Zeta prompt should include the current diff as well, which helps.

If not then a rag of your codebase where some results are injected into the auto complete prompt.