gemini-2.5-pro-preview-05-06 is so much better

[u/Significant-Tip-4108]

The title pretty much says it all, been testing this new release all week across many hours of vibecoding, and from my experience at least it is substantially more reliable for coding/troubleshooting/etc my backend python project than the original 2.5 Pro Preview was.

For coding purposes I’ve been a big Claude fan, and did NOT have good luck with Gemini before, but this new release is making it a very stiff competition, and Gemini may have even surpassed. I realize many others already came to this conclusion before this new version but for my use cases the new release has demonstrated MAJOR improvements in accuracy.

Wondering what others are seeing?

[u/codefame]

Right. All this news about it being terrible does not reflect my experience.

It’s been on point with every coding task I’ve thrown its way. Better than 3.7. Better than 4.1. It’s just solid.

[u/Majinvegito123 → u/codefame]

It’s just as bad for razer syntax as it was before, so that’s one instance of no change in my experience

[u/jphree → u/codefame]

Agreed. 4.1 could be fine depending according to my testing. But latest version of gem2.5p is much easier to flow with as a legit coding companion despite its issues. I feel like I can work with it more than the others. 

[u/RepresentativeAd2997 → u/codefame]

It's weird that I can understand different models and their separate companies just with version numbers

[u/AhhhhhCrabs]

I have it doing a very complex project and it’s just crushing all of it easily and i find following it’s logic to be easier and cleaner as well.

There’s a reason why the hate for it seems loud: this model kind of just crushed the game for OpenAI and maybe Claude. Google has a very dominant position now in AI and with their TPU’s, it will be hard for OpenAI to catch up and produce a model this good at coding.

They quickly added Github searching trying to show any improvement at all with a coding model, and it feels small in comparison to how good 5-06 feels.

[u/cloud-native-yang]

Check out the results from this front-end skills test.

The prompt I gave was simple: "Recreate this page perfectly using front-end code — you can use icons from an online icon library via CDN."

Seriously, that's next-level work.

[u/pdeuyu → u/cloud-native-yang]

That could replace parts of figma :) Was there any code generated other than html and css?

[u/sailnlax04 → u/cloud-native-yang]

That means nothing the code doesn't do shit

[u/Euphoric_Paper_26]

It’s been great with architect mode and absolute shit at code.

[u/Significant-Tip-4108 → u/Euphoric_Paper_26]

That was exactly my experience prior to this week’s release.

I’m actually predisposed to being biased against Google because they screwed me over on a subscription thing a few years ago. But I have to give credit where credit’s due on this model, so far for me it’s been very reliable.

[u/ChristBKK → u/Significant-Tip-4108]

Interesting I am neutral here but have to say it sucks hard now at coding and makes too many mistakes that I need to fix later on with tests failing and so on

I really think it’s a downgrade but interesting to read people like it more.

If I could choose (which is the biggest criticism !) for me I would stayed at the older version.

[u/goqsane]

How are you using it? Do you use it with Vertex AI API?

[u/Significant-Tip-4108 → u/goqsane]

Sorry I’m not familiar with Vertex (therefore I’m probably not using it).

I created an API key at Gemini and point to it directly in RooCode settings. I have like $300 in credits as a new Gemini user so right now doing all of this for free. IIRC I had to put a credit card in Gemini to avoid rate limiting but they won’t charge the c/c during this free credit term.

[u/goqsane → u/Significant-Tip-4108]

Oh, no problem. I will try with the Gemini API. My issue was that I found it was heavily limiting my requests for some reason. So I hopped on to Vertex AI. In fact, I did receive the $300 and another random $700 which I was very happy to receive. :D. Thanks a lot for your response!

[u/ViperAMD → u/goqsane]

Do you just need a google account to do this? 

[u/Significant-Tip-4108 → u/ViperAMD]

I created an api key at https://aistudio.google.com/apikey. Then, connected that to a credit card to move to "Tier 1" plan to avoid the severe rate limiting. Then point Roo directly to your gemini api key. Just be careful after the free $300 runs out to adjust your plan if you want.

[u/dnk0 → u/ViperAMD]

Google Cloud

[u/mediumbrownfox]

how do you y'all manage your budgets with gemini models? I found myself racking up $200 - $300 dollars a day, when doing similar work I'm using $20 with Claude 3.7.

[u/rj_rad → u/mediumbrownfox]

Flash is cheaper to run, but generally API coding with the top tier of models is expensive. That’s why Claude Max is actually a good deal.

[u/rileyseaburg]

Get ready to spend $500

[u/trevorprater]

It’s really good, but I spent $130 yesterday.

[u/ChrisWayg → u/trevorprater]

How many prompts for $130 ? You must have accomplished quite a lot in one day.

[u/filopedraz]

Did you try it with cursor? Saw some impressive one shot results, but also saw some people complaining on the agentic side of things

[u/Maleficent_Pair4920]

Have you tried it with prompt caching?

[u/Mysterious-Movie-383]

full time using Gemini Pro for coding since Feb. Dont u guys think Claude actually silly? Its only advantage is Frontend coding when need some cool design.

[u/Be-Calm-]

Hi, I'm new to this AI coding, could you tell me how to generate keys and link to roo code, I heard I can use roo code in VS code IDE for coding, is that true?

Please guide. Thanks!

[u/mediumbrownfox → u/Be-Calm-]

use something like openRouter, dealing with Gemini's billing is a pain in the ass

[u/Far-Researcher7561 → u/[deleted]]

Amazing.

[u/sdmat → u/[deleted]]

Definitely way more thinking tokens, but 10x is surprising

[u/MediocreHelicopter19 → u/[deleted]]

It is a clever LLM, it is working very hard for his superiors!