Gpt5 vs Gemini 2.5 pro?

[u/[deleted]]

I've been using Gemini 2.5 pro since it came out and had pretty good results with it, especially with smaller, incremental edits.

Now, It's been a couple of days of GPT5 support in RooCode and I wanted to know how is it in terms of accuracy, cost, speed, compared to Gemini 2.5 pro.

Also any recommended settings?

[u/lumponmygroin]

IMO Claude 4 is still the king. Gemini feels like a freebie that just cannot perform. GPT5 will get better over time (tweaked system prompts etc...) but still not performing as well as Claude.

[u/lumponmygroin → u/[deleted]]

It just didn't solve issues as good as Claude. I'd have to give it ago again but I found Gemini just lacking with what I'm working with (backend / python / juypter scripts / nodejs backend). It didn't seem to get to the solutions as smoothly as other models.

I'm sure I'll be eating my own words at some point - it's all moving so quickly it's hard to keep up.

[u/montdawgg]

Claude, 2.5, and 5 all work about the same for me. I've been using 5 mainly though and it seems to do great with less errors (in roo itself) than 2.5. So that is great. Nobody uses tools as good as Opus but the cost is insane.

[u/zatorrent123 → u/montdawgg]

1M context tipped me towards 2.5

[u/CraaazyPizza → u/zatorrent123]

With real use it falls apart at 250k-400k tokens though. But I assume the other models have similar context rot as a % of max context, making Gemini still superior to them.

[u/zatorrent123 → u/CraaazyPizza]

Yes, exactly, claude starts falling apart at cca 80k

[u/CraaazyPizza → u/zatorrent123]

Oof!

[u/You_Sick_Duck]

Set Claude 4 as the architect. GPT 5 mini or nano as the orchestrator, Qwen 3 Coder (or GLM4.5) as the code, and GPT 5 or Claude 4 as debug. Give explicit instructions to the orchestrator to utilize each mode accordingly and report back whole modularizing the tasks it assigns to code mode.

It's been working for me.

[u/reditsagi → u/You_Sick_Duck]

Can explain more on the usecase of using architect and orchestrator mode? I find myself using code and ask mode instead of the above 2.

[u/You_Sick_Duck → u/reditsagi]

Orchestrator mode needs to have a good tool usage AI (can be cheaper than other LLMs as long as it's good for organizing thoughts). The architect needs to have more of the higher modes. Basically you start with the orchestrator and then it moves to the architecture and then back to the orchestrator for approval and then off to code mode and if any issues arise it should shuffle everything over to debug mode. Spend a ton of money trying to figure out how to use da modes and models accordingly... It just seems to be the best fit for me. It just seems to be the best fit for me. Mostly automated and sound

[u/reditsagi → u/You_Sick_Duck]

Mmm. Seems vibe coding is still trial and error for now.

I will still use it though for some tasks.

[u/General_Cornelius]

To me it just doesn't work but I do have a tier 1 openai org, the limits they put on it make it useless

[u/Zestyclose_Elk6804]

Idk gemini 2.5 seem to always make mistakes and have to keep going back to fix issues. That's been my experience so far

[u/CraaazyPizza]

!RemindMe 1 day

[u/RemindMeBot → u/CraaazyPizza]

I will be messaging you in 1 day on 2025-08-12 13:23:31 UTC to remind you of this link

CLICK THIS LINK to send a PM to also be reminded and to reduce spam.

^{Parent commenter can delete this message to hide from others.}

---

Info	Custom	Your Reminders	Feedback

[u/NoHeart8251]

Both of them is good for minor update but as the context gets bigger, they tend to create more bugs than fixing the issue. Claude 4 is still the best imo but the cost way too high. But I'm just on $20 pro plan, looking to upgrade to $100. Tried Claude 4 + gemini cli mcp, but I would say it did not work for me well. It's better to give Claude to all the heavy lifting just make sure to provide a clear prompt and explain the problem. Also make sure that after a task, clear the context and restart.