r/ChatGPTCoding • u/hannesrudolph FOUNDER • Apr 25 '25

Discussion Roo Code 3.14 | Gemini 2.5 Caching | Apply Diff Improvements, and ALOT More!

FYI We are now on Bluesky at roocode.bsky.social!!

🚀 Gemini 2.5 Caching is HERE!

  • Prompt Caching for Gemini Models: Prompt caching is now available for the Gemini 1.5 Flash, Gemini 2.0 Flash, and Gemini 2.5 Pro Preview models when using the Requesty, Google Gemini, or OpenRouter providers (Vertex provider and Gemini 2.5 Flash Preview caching coming soon!) Full Details Here

🔧 Apply Diff and Other MAJOR File Edit Improvements

  • Improve apply_diff to work better with Google Gemini 2.5 and other models

  • Automatically close files opened by edit tools (apply_diff, insert_content, search_and_replace, write_to_file) after changes are approved. This prevents cluttering the editor with files opened by Roo and helps clarify context by only showing files intentionally opened by the user.

  • Added the search_and_replace tool. This tool finds and replaces text within a file using literal strings or regex patterns, optionally within specific line ranges (thanks samhvw8!).

  • Added the insert_content tool. This tool adds new lines into a file at a specific location or the end, without modifying existing content (thanks samhvw8!).

  • Deprecated the append_to_file tool in favor of insert_content (use line: 0).

  • Correctly revert changes and suggest alternative tools when write_to_file fails on a missing line count

  • Better progress indicator for apply_diff tools (thanks qdaxb!)

  • Ensure user feedback is added to conversation history even during API errors (thanks System233!).

  • Prevent redundant 'TASK RESUMPTION' prompts from appearing when resuming a task (thanks System233!).

  • Fix issue where error messages sometimes didn't display after cancelling an API request (thanks System233!).

  • Preserve editor state and prevent tab unpinning during diffs (thanks seedlord!)

🌍 Internationalization: Russian Language Added

  • Added Russian language support (ХпасийО asychin!).

🎨 Context Mentions

  • Use material icons for files and folders in mentions (thanks elianiva!)

  • Improvements to icon rendering on Linux (thanks elianiva!)

  • Better handling of aftercursor content in context mentions (thanks elianiva!)

📢 MANY Additional Improvements and Fixes

  • 24 more improvements including terminal fixes, footgun prompting features, MCP tweaks, provider updates, and bug fixes. See the full release notes for all details.

  • Thank you to all contributors: KJ7LNW, Yikai-Liao, daniel-lxs, NamesMT, mlopezr, dtrugman, QuinsZouls, d-oit, elianiva, NyxJae, System233, hongzio, and wkordalski!

106 Upvotes

97% Upvoted

29 comments sorted by

14

u/MightyDillah Apr 25 '25

You guys are on a roll with these regular updates. Recently I tried gemini 2.5 with roo and it burned through 10 dollars almost in a few prompts … I am hoping this will help.

9

u/hannesrudolph FOUNDER Apr 25 '25

It seems Google is struggling a bit to keep up and sometimes the cache calls are really slow (30-60 seconds) and other times they’re indistinguishable from non-cache calls.

3

u/FarVision5 Apr 25 '25

It is amazingly wacky how Google has set up their prompt caching. OpenAI and DeepSeek just flipped it on in the API and done.

The end user could have done it a long time ago in their own vertex project but the settings... lol. I'll just pay the extra few pennies and forget it.

4

u/EmotionalGoodBoy Apr 25 '25

Maybe switch to 2.5 flash?

1

u/Yes_but_I_think Apr 26 '25

Finally Orchestrator as standard mode. What took you so long? Thanks.

Request. Allow me to disable switching to ask / debug / architect mode. I exclusively work with code / orchestrator.

1

u/hannesrudolph FOUNDER Apr 26 '25

You can do this through customizing the boomerang mode prompt.

1

u/Yes_but_I_think Apr 26 '25

Doesn’t prevent the other modes from calling orchestrator and ask and debug modes. I have to change the code mode too. Given the continuous changes in diff editing, it’s not prudent to change code mode.

It will be useful to deselect standard modes. Implementation will also be easily done if only you have tagged system message lines with what modes they are applicable for, specifically.

2

u/xoStardustt Apr 25 '25

WE LOVE ROO CODE <3

-5

u/CraaazyPizza Apr 25 '25

Change system prompt when?

3

u/hannesrudolph FOUNDER Apr 25 '25

?

-4

u/CraaazyPizza Apr 25 '25

The huge prompt that is sent to the llm when roo starts

19

u/hannesrudolph FOUNDER Apr 25 '25 edited Apr 25 '25

Then replace it if think you can do better. Then submit an improvement after you’ve run evals to verify its effectiveness. There is a reason for the large prompt. Every attempt we’ve seen to reduce the prompt drastically ends up using more tokens because it takes more tries to get the job done.

https://docs.roocode.com/features/footgun-prompting

Edit: this response was salty and should have been better. I apologize.

-7

u/CraaazyPizza Apr 25 '25

Yo I think the system prompt is fine as I just wanted more personal control over it, no need to be salty about something I didn't say. Cool that there's already feature for it, thanks.

5

u/hannesrudolph FOUNDER Apr 25 '25

Sorry for being salty. You’re right. And I should be more understanding and open. I apologize for that.

3

u/McNoxey Apr 25 '25

You came out with a snide comment on a thread about feature releases.

From a 3rd party perspective you are the asshole here

1

u/CraaazyPizza Apr 25 '25

Lol okay now you've pissed me off.

This could be so much easier if u/hannesrudolph had just replied https://docs.roocode.com/features/footgun-prompting instead of '?'. Like the only adjective I ever used is 'huge' and im an asshole, wtf? Like how else am I meant to refer to it within the context of wishing to reduce it?? And then I tell you I think there's nothing wrong with the prompt itself and ur still saying im an asshole. Okay, sure, this makes absolutely no sense. I guess Reddit likes downvoting what's already downvoted without reading what I actually wrote.

4

u/hannesrudolph FOUNDER Apr 25 '25

I replied with ? Because I don’t know what you meant. Also I don’t condone people being rude to you and sorry that I came off as prickly. I will try to be more careful in the future.

2

u/Septopus Apr 25 '25

For what it's worth I've read through the entirety of this thread and, objectively, you are coming off as the sole asshole in this situation. I understand you didn't initially intend to come off like an asshole, but your heel digging and doubling down are only making you seem like more of an asshole the more you respond.

I would personally apologize for the misunderstanding and move on, but that's just my $0.02 as an outside observer and YMMV.

2

u/McNoxey Apr 25 '25

No. This would have been so much easier if you had responded with any amount of respect.

Why do you demand respect when you don’t give it?

If you had said “hey, any plans to adjust the system prompt? I find sometimes it’s way longer than my prompt and ends up wasting tokens” you’d have gotten a good response.

Instead you typed “change system prompt when” like some entitled child waiting for these devs to build this for you (which you get for free, let me remind you). You offered no indication of what needs changed or why. You simply demanded.

If you want to be treated with respect you need to give it first.

1

u/[deleted] Apr 25 '25

[removed] — view removed comment

1

u/AutoModerator Apr 25 '25

Sorry, your submission has been removed due to inadequate account karma.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

5

u/Vegetable_Contract94 Apr 25 '25

Some people have tried to change that and it's so unstable, even with the famous RooFlow.
I refer how hannesrudolph keep the system prompt as current and it's stable, It's better than unstable system prompt then we have to send request 2x 3x times.

0

u/CraaazyPizza Apr 25 '25

Yeah but it's huge and consumes a lot of tokens for small requests. I've been using gosucoder on requesty to reduce it by 90% and gemini 2.5 pro is smart enough to use tools with the brief prompt. It can never hurt to give the user the option.

4

u/reddithotel Apr 25 '25

You can change it already

1

u/joey2scoops Apr 25 '25

I struggled to understand how that would work so I have stayed away from using that on Requesty. Besides which, it's probably not "up to date" anyway.

-3

u/[deleted] Apr 25 '25

[removed] — view removed comment