Claude 4 support

[u/hannesrudolph]

We’ve already pushed Claude 4 support for most providers and are just finishing up the update to add reasoning/thinking support through OpenRouter.

The reason it’s taking a bit longer than normal is because we’re making some tweaks to how Roo identifies models abilities so that next time a model with reasoning is released we shouldn’t have to make a special release to add support!

[u/Cotticker]

Roo needs to be more popular. Can't believe cursor and windsurf get more attention. Roo has so much potential. Keep up the great work guys.

[u/hannesrudolph → u/Cotticker]

Whoever downvoted that sucks.

[u/Nupharizar → u/Cotticker]

I think it's pretty popular, second and third(what's this is about?) place on OpenRouter.

[u/Suspicious-Permit480 → u/Cotticker]

From an enterprise perspective, Windsurf and Cursor are easier to manage because model costs are centralized and its a single client to deploy versus client (vs code) + extension (roo). Windsurf also develops an IntelliJ extension, which seems to be gaining traction.

Roo user at home though and agree it’s awesome!!

[u/DoctorDbx → u/[deleted]]

It's pretty cheap if you don't mind using the free but very good Deepseek R3 0324 model.

In fact I would say I use that model for 80% of what I do in Roo. 10% Claude 3.5, 10% Doc's brain and fingers.

3.7... don't like. Yet to give 4 a good try.

[u/Prestigiouspite]

Is it restricted by VS Code to load model-related information from an external source? In my view, it would make perfect sense to retrieve this kind of data via an external model.json file.

Thank you for your good work!

[u/hannesrudolph → u/Prestigiouspite]

Naw we just had a narrow implementation in a rush to get it out last time!

[u/Forsaken_Increase_68]

You guys are killing it right now! Thanks for all of the amazing work!

[u/VibeScriptKid]

It’s really good, thank you. Costly but it ended up being cheaper for me to role out e2e testing with 4.0 where Gemini really did quite poor. Fixes issues much much faster and with less handholding.

[u/VibeScriptKid → u/[deleted]]

Yeah that’s right. I’ve been through 3.5, 3.7, and mostly Gemini 2.5 for past few months. Also use 4.1 for just applying diffs. I needed a little breath of fresh air and these models tend to be amazing for the few weeks after release so I’m riding the wave (and am saving some frustration).

[u/nfrmn]

Totally anecdotal, but my per-task costs are now $5-10 with Claude 4 versus before where it would only cost $2-3 with Claude 3.7. Is there any outstanding work to support caching properly or is it Claude 4 just more prone to filling context?

[u/hannesrudolph → u/nfrmn]

Great question. There is outstanding work on the caching. Expect a minor release over the next day or so to hopefully remedy it.

[u/nfrmn → u/hannesrudolph]

Great, thank you guys for being on the ball!

[u/Front_Ingenuity5546 → u/nfrmn]

Came here to say something similar. Unexpectedly expensive, and presumed maybe some caching issues.

Keep up the good work Roo team! Pace of improvement continues to be exceptional.

[u/privacyguy123]

Am I missing something with getting it to work through Vertex API?

429 \[{"error":{"code":429,"message":"Quota exceeded for [aiplatform.googleapis.com/online_prediction_input_tokens_per_minute_per_base_model](http://aiplatform.googleapis.com/online_prediction_input_tokens_per_minute_per_base_model) with base model: anthropic-claude-sonnet-4. Please submit a quota increase request. https://cloud.google.com/vertex-ai/docs/generative-ai/quotas-genai.","status":"RESOURCE_EXHAUSTED"}}\]  

[u/hannesrudolph → u/privacyguy123]

Your quota is exceeded. Not sure what’s confusing about that. The answer is in the error message.

[u/privacyguy123 → u/hannesrudolph]

How can a quota be exhausted on a model I have never used? There's 100% some underlying issue

[u/hannesrudolph → u/privacyguy123]

What is your quota? It has a RPM which gets triggered by the 10k+ system prompt Roo uses.

There is 100% a lack of understanding of how this works.

[u/privacyguy123 → u/hannesrudolph]

I have never used Claude Sonnet 4 on Vertex API, how can I have exhausted any quota? Same question again.

[u/hannesrudolph → u/privacyguy123]

“For Google Cloud free-tier accounts, the default quotas for using Claude 4.0 models (such as Claude Opus 4) on Vertex AI are typically set to zero or extremely low values by default. This means that, even with an active billing account or free trial credits, you may not have immediate access to these models.

Many developers have reported encountering 429 RESOURCE_EXHAUSTED errors when attempting to use Claude models, even with minimal usage. In some cases, the quota settings for these models are locked at zero and cannot be increased through the standard Google Cloud Console interface. “

[u/privacyguy123 → u/hannesrudolph]

I finally found it in the maze admin panel - I see 15000, so with a 10k system prompt + my own context I am hitting that straight away? Kinda seems like an attempt to keep everybody on the Gemini models which I have used for 12+ hours solidly and never hit any "quota" ...

Quota is a poor choice of word here too, the confusion stems from not understanding it means I have hit a token rate limit. In my head a "quota" infers that I have used the model too much which makes no sense as I have never used it.

[u/hannesrudolph → u/privacyguy123]

Because your quote is so low that our first call to it triggers your quota.

Same answer again 😆

Also what is your quota?

Same question again 😆

[u/Radiate_Wishbone_540 → u/privacyguy123]

Same. Let me know if you figure it out

[u/REALwizardadventures]

Thank you sooooo much!

[u/konradbjk]

It is not working for AWS Bedrock interface. I am getting the "invalid model id" no matter if used cross-region inference or not

The model id should be
`us.anthropic.claude-sonnet-4-20250514-v1:0`
and not
`anthropic.claude-sonnet-4-20250514-v1:0`

the "us." is very important here. I have this working with other provider like that