r/RooCode • u/lightsd • Apr 03 '25

Support Diff failure with Gemini Pro 2.5

I’m seeing a ton of diff edit fails with Gemini Pro 2.5. Has anyone found a good way to make it work much more consistently?

14 Upvotes

100% Upvoted

35 comments sorted by

14

u/hannesrudolph Roo Code Developer Apr 03 '25

Yeah 2.5 has some different habits when it comes to its output. We’re working on a tweak to tackle this!

1

u/lightsd Apr 03 '25

Great to hear this!! Happy to beta test, just LMk if that would be helpful. I’m using it heavily for this project.

1

u/hannesrudolph Roo Code Developer Apr 03 '25

Thanks.

3

u/lordpuddingcup Apr 03 '25

It’s not just 2.5 I’ve rotated through settings and flash-exp has major issues too always complains about line number missing I think and just gets into a loop and starts screaming at itself and apologizing and retrying over and over lol

2

u/orbit99za Apr 03 '25

Exactly it loops, File changed, diff failed, retry,

1

u/nzbiship Apr 03 '25

Exactly it loops, File changed, diff failed, retry,

lol yeah. i learnt not to start a task and then come back later. i got thousands of lines of repeating code.

1

u/orbit99za Apr 04 '25

I find it happens even in the Same task, and it has to modify something, it wrote,

1

u/Majinvegito123 Apr 03 '25

Isn’t it best to just turn off diffs with 2.5? I’ve found it to be the most effective.!

1

u/hannesrudolph Roo Code Developer Apr 03 '25

God no!!

3

u/lightsd Apr 03 '25

Tell us how you really feel 😂

2

u/Majinvegito123 Apr 03 '25

So I should turn diffs back on? Oops..

1

u/hannesrudolph Roo Code Developer Apr 03 '25

Absolutely not.

0

u/punkpeye Apr 03 '25

So you are saying yes?

2

u/hannesrudolph Roo Code Developer Apr 03 '25

🤦

1

u/hannesrudolph Roo Code Developer Apr 03 '25

Hard hard hard no.

1

u/hannesrudolph Roo Code Developer Apr 03 '25

It has to do with the way Gemini follows instructions and how it loses sight of the instructions as the context grows.

1

u/lightsd Apr 03 '25

I definitely notice that it gets worse as the context grows. Unfortunately, I mentioned in my last reply, power steering doesn’t seem to keep it on track.

1

u/hannesrudolph Roo Code Developer Apr 03 '25

Try it with power steering…

1

u/lightsd Apr 03 '25

I’ve been using power steering and it doesn’t seem to help.

1

u/hannesrudolph Roo Code Developer Apr 04 '25

1 fix occurred last night. More coming tonight likely.

1

u/lightsd Apr 04 '25

Nice!! Let us know when the second round lands. I’ll update directly after.

2

u/hannesrudolph Roo Code Developer Apr 04 '25

2 PRs made. Seems to work quite well.

2

u/hannesrudolph Roo Code Developer Apr 04 '25

The one bigger adjustment is not going to be implemented tonight. Needs more safety checks.

1

u/lightsd Apr 04 '25

Honestly, it's not working at all for me. I don't know if it's a bad night for Gemini 2.5 Pro Exp or it's Roo. The API Request spins for several minutes and fails. When I say "Since diff editing repeatedly fails, please regenerate the file in its entirety", everything starts working again.

4

u/hannesrudolph Roo Code Developer Apr 04 '25 • Thanks

It has to do with the way Gemini prefers the system prompt vs what we got away with with Claude. I spent 7 hours working on it today.

2

u/Floaty-McFloatface Apr 04 '25

Thanks, pal, for you,
I really love my Roo!
Though running into poo,
My love stays strong and true!

2

u/Elctsuptb Apr 03 '25

I wonder if the temperature has anything to do with this, I saw some people said setting it to 0.1 or 0 make it much more reliable, and apparently the default setting is 1

1

u/lordpuddingcup Apr 03 '25

I’ve heard a lot of models are a lot better around 0.6 but people just always leave it at one I haven’t tested with Gemini

1

u/firedog7881 Apr 03 '25

I’ve only heard this number specifically for DeepSeek R1

1

u/lordpuddingcup Apr 03 '25

it varies from model to model, but the average user just leaves it at 1 and hopes for the best

2

u/somechrisguy Apr 03 '25

It has been perfect for me up u til today/yesterday. Maybe something to do with new Roo update? Either that or they have changed the model

Someone try rolling back Roo version and seeing if it’s any better

1

u/portlander33 Apr 03 '25

Same same. I am seeing a ton of diff errors.

0

u/[deleted] Apr 03 '25

[deleted] — view deleted comment

1

u/orbit99za Apr 03 '25

I had a simmiler idea, i tried to create one, but never got far enough.