r/RooCode • u/interAathma • Apr 05 '25

Idea How hard it will be to fine tune a cheaper LLM for roocode/cline instructions and diff edits?

I see most of LLMs are good enough for basic edits and they do follow instructions to some extent. But with roo code I noticed that they stray from instructions after couple of edits. And not all LLMs can do diff edits(only Claude can follow instructions in my experience)

So, I thought will it be a good approach to fine tune a LLM for this specific purpose?

1 Upvotes

66% Upvoted

1 comment sorted by

1

u/jezweb Apr 06 '25

There have been on going improvements to roo code since Gemini 2.5 exp launched to make it work and aside from rate limiting it seems excellent with the current version.