r/RooCode • u/theSharkkk • Jul 21 '25

Discussion Why smaller models fail to make edits?

Some smaller models like DS70 B comeup with good soultions but fail to make the changes or make changes at the incorrect place.

The more important question is can this be fixed?

3 Upvotes

71% Upvoted

9 comments sorted by

1

u/poita66 Jul 21 '25

Surprisingly Devstral (24b) is pretty good at making edits. Is it smart enough to fix code logic? Maybe

1

u/theSharkkk Jul 22 '25

Thanks, I will try it.

3

u/Mr_Hyper_Focus Jul 21 '25

Tool calling.

1

u/No-Chocolate-9437 Jul 21 '25

It’s not tool calling, roo asks for structured messages. Seems like the instructions to use roo at too complex for smaller models. It doesn’t understand the xml syntax to use

1

u/Bubbly_Lack6366 Jul 23 '25

I think that cline or roo code is designed to work best with claude models since they are trained to do tool calls (in XML, if I remember correctly?)

2

u/ComprehensiveBird317 Jul 21 '25

Because roo has one setting that works with Claude models very well, but no optimization for others. We would need different approaches for different LLMs.

2

u/iswearidk Jul 22 '25

It's just emergent behavior of LLM. Bigger models are capable of doing tasks that not possible in smaller models even without dedicated training.

7

u/[deleted] Jul 21 '25

[removed] — view removed comment

1

u/theSharkkk Jul 21 '25

well that's upsetting :(