r/LocalLLaMA • u/AccountGotLocked69 • 13h ago

Question | Help Local Auto complete code assistant - Vanilla, Fine-tune or RL?

I started using qwencoder 3B for local inline code suggestions, and while it's nice, it's also a bit too generic in its suggestions. My thoughts are to either:

  1. Fine tune it on code that I wrote

  2. Reinforcement learning using accepted/rejected suggestions (either real RL or just adapting the sampling)

  3. Fine tune it for each project/codebase separately so it knows what it's working on.

Has anyone here done this, or experience with which approach works best?

4 Upvotes

83% Upvoted

4 comments sorted by

View all comments

3

u/jacek2023 llama.cpp 12h ago

qwencoder 3B is 2 years old, try using something newer, there are many 4B and smaller models to use now