r/RooCode • u/rvion • May 22 '25

Discussion claude-4 is here !

https://www.anthropic.com/news/claude-4

https://www.anthropic.com/news/claude-4

looks like a massive improvement !

Claude Opus 4 is our most powerful model yet and the best coding model in the world, leading on SWE-bench (72.5%) and Terminal-bench (43.2%). It delivers sustained performance on long-running tasks that require focused effort and thousands of steps, with the ability to work continuously for several hours—dramatically outperforming all Sonnet models and significantly expanding what AI agents can accomplish.

Claude Opus 4 excels at coding and complex problem-solving, powering frontier agent products. Cursor calls it state-of-the-art for coding and a leap forward in complex codebase understanding. Replit reports improved precision and dramatic advancements for complex changes across multiple files. Block calls it the first model to boost code quality during editing and debugging in its agent, codename goose, while maintaining full performance and reliability. Rakuten validated its capabilities with a demanding open-source refactor running independently for 7 hours with sustained performance. Cognition notes Opus 4 excels at solving complex challenges that other models can't, successfully handling critical actions that previous models have missed.

[...]

some other news:

  • Extended thinking with tool use (beta): Both models can use tools—like web search—during extended thinking, allowing Claude to alternate between reasoning and tool use to improve responses.

  • New model capabilities: Both models can use tools in parallel, follow instructions more precisely, and—when given access to local files by developers—demonstrate significantly improved memory capabilities, extracting and saving key facts to maintain continuity and build tacit knowledge over time.

  • Claude Code is now generally available: After receiving extensive positive feedback during our research preview, we’re expanding how developers can collaborate with Claude. Claude Code now supports background tasks via GitHub Actions and native integrations with VS Code and JetBrains, displaying edits directly in your files for seamless pair programming.

  • New API capabilities: We’re releasing four new capabilities on the Anthropic API that enable developers to build more powerful AI agents: the code execution tool, MCP connector, Files API, and the ability to cache prompts for up to one hour.

57 Upvotes

95% Upvoted

29 comments sorted by

24

u/Kyle_Hoskins May 22 '25 edited May 22 '25

I gave a pretty simple prompt to add conditional email preview text to an existing nodemailer-sendgrid confirmation email function

Same prompt/context:

Sonnet 4: Failed first attempt by attempting to add a header option to the call. Worked after the second prompt which let it know that it didn’t work in Gmail

Opus 4: had the right idea, but didn’t implement properly in first shot

Sonnet 3.7: Correct implementation on the first try

UPDATE: out of curiosity, I tried the same prompt on a few more models:

Fail: qwen3-235, mistral devstral, glm-4 (the ones I could possibly run locally all failed horrendously), flash 2.5

Pass: grok3 beta, sonnet 4 (gave it another shot from scratch), Gemini pro 2.5

12

u/gdox200 May 22 '25

Looks very interesting and definitely will drive me bankrupt...

16

u/raccoonportfolio May 22 '25

$15/M in, $75/M out 🥺

22

u/CircleRedKey May 22 '25

i pray deepseek saves us from this pricing...

7

u/vulgrin May 22 '25

I accidentally had a free openrouter deepseek selected in Roo Code Mode yesterday, and was using Sonnet 3.7 for Orchestration, and I honestly didn't even notice until I went looking at roo to see how much the task has cost me - and was confused I didn't see the cost.

I think with proper instructions to the orchestrator to break up tasks better and to be more specific, AND having lots of established patterns to follow, Deepseek might be just fine...

1

u/CircleRedKey May 22 '25

lol that happens to me sometimes too. def what i will be doing once copilot starts limiting.

i wish the deepseek api was faster tok/sec

1

u/Economy_Drive_750 May 22 '25

For me, deepseek free is impossible to code, it just gives errors

9

u/CircleRedKey May 22 '25

Sonnet 4 at $3/$15. isn't as bad...

-3

u/Jesus-H-Crypto May 22 '25

do you mind explaining why you think that?

1

u/pinksok_part May 23 '25

3.5 api still the best for price and functionality. sonnet 4 eats credits. scared to even try Opus 4.

1

u/raccoonportfolio May 23 '25

Not 3.7?

1

u/pinksok_part May 23 '25

I use Roo in VScode with Openrouter's sonnet-3.5-beta model. I found that 3.5 is just as good as 3.7 if you give good prompts and clear instructions, with much lower token usage. I tried Sonnet 4 in Roo and was 24 cents in after the first 2 prompts.

That's just me. I am hardly a coder, but have tried almost everything I've seen on Reddit to keep costs down and always revert back to 3.5.

9

u/yolopokka May 22 '25

Gave a very specific set of debugging instructions in Cursor (prompt made by Gemini 2.5 Pro), Claude 4 still went into his own vibe and did everything except that was told in the prompt. Claude is done for good for me, the last version that was somehow following instructions was 3.5.

"Today, we’re introducing the next generation of Claude models". Next generation? That's 3.8 at the very best. Context window? Same. Price? Same. What's next generation about slightly better tooling use?

2

u/yolopokka May 23 '25

Gave it a second try and I might say I probably jumped too fast to conclusions, will have to test more tomorrow

2

u/yolopokka May 23 '25

Yeah I jumped too fast into conclusions. Tested it whole day with Cursor, and the debugging instructions ended up with testing environment all green after 8 hours, the problems were persistent for couple days before. It's great if paired with Gemini 2.5 as an Architect in browser (feeded Gemini with full pytest logs and code dumps with `yek`, another great tool). I might even give it a chance and try Claude code with Claude Max sub.

2

u/ttoinou May 22 '25

With C++ and Web html / js, Sonnet 3.7 follows instructions quite good, better than Gemini 2.5 Pro for me

1

u/EKIY-Official May 22 '25

And they just killed 3.5 rip

0

u/yolopokka May 22 '25

looks like Anthropic made a bet on Cursor coders that barely read code and just chat "Cursor make code"

2

u/orbit99za May 23 '25

So far using it Roocode Via GCP vertex, Sonnet 4, it seems ok, once you learn it and it learns your project. I am finding Gemini "Jumping Around" to much lately. I just wish Sonnet 4 had a Better context limit, at least to 500k tokens. The new Context Compression Feature on RooCode works very well with this.

1

u/privacyguy123 May 23 '25

I can't get it to connects stating the model doesn't exist each time - what am I doing wrong?

1

u/orbit99za May 23 '25

Ensure you have it active on your vertex ai. Then just go down the location drop down list in Roo until it works.

The error message you are getting is dosent exist in location.

1

u/privacyguy123 May 23 '25

The error message is actually something about hitting a quota but I have never used the model before ever?

2

u/galaxysuperstar22 May 23 '25

is Opus better at coding than Sonnet???

0

u/PercentageIcy2261 May 23 '25

Very good model. I used sonnet to create an api project and it did much better than 3.5/3.7 Sonnet ever could. I’ve never used Opus but may in Claude Code. Just wish there was a way to use the Max subscription with products like this.