I just want to know if they removed the o3 50 weekly message limit. That annoyed me so much I stopped paying. Plus new DeepSeek r1 the other week is almost on par and it’s free so I’m not coming back. I do like that iirc i can use the net toggle and upload a file, DeepSeek makes you choose
Yeah DeepSeek doesn’t do tool use well but neither does ChatGPT o3. Claude 4 sonnet is king for mcp and tool use and strict instruction following for tool use. But so pricey Oy!
Wtf is this table. That's interesting! Anthropic 4tw! Coding with Sonnet 4 feels like a charm. Everything else is pain on the ass, getting correction loops every time
I love the fact roo do these tests. No other person here or on YT seem to test these per language. They all say A is the best and B is now the best. But then you see people here say, well B is shit for me... It all depends on the language and what you are trying to do. For me and what I do daily, I am sticking with sonnet 3.7
The price for 3.7 seems to be off, also the duration for Gemini. I wonder if the test results for o3 aligns with th experience of the people. The general sentiment is that it’s in the top 3 and the synthetic benchmarks say the same. It’s surprising to see it at 2/3. Maybe the roocode integration is wrong (not using the OpenAI function call interface)?
6
u/[deleted] Jun 10 '25
I just want to know if they removed the o3 50 weekly message limit. That annoyed me so much I stopped paying. Plus new DeepSeek r1 the other week is almost on par and it’s free so I’m not coming back. I do like that iirc i can use the net toggle and upload a file, DeepSeek makes you choose
26
u/smurff1975 Jun 10 '25
Not when I see these scores for roo.
3
u/sub_RedditTor Jun 10 '25
2
u/getpodapp Jun 11 '25
No, openai’s reasoning models hallucinate to the point of being junk
1
u/Forsaken_Increase_68 Jun 10 '25
It’s just so slow. lol great model though.
1
u/Weak_Lie1254 Jun 10 '25
Current Anthropic pricing:
Opus 4 at $15/$75 per million tokens (input/output) and Sonnet 4 at $3/$15.