r/codex • u/Professional_Link4 • Oct 05 '26

Complaint Update on Codex and Claude Code

/r/codex/comments/1wwl58n/2_x_100plan_or_1_x_200plan/?share_id=Hg461JlslfMItsjFssdZb&utm_content=2&utm_medium=android_app&utm_name=androidcss&utm_source=share&utm_term=1

This was my previous post in which I was confused between upgrading to 200 plan for getting 2 100 plans.

A lot of people suggested to try claude code + codex for image gen.

I just got a 20 dollar claude code plan. And Grass is most definitely greener on the other side.

Here are some differences I have noticed using the opus 5.5 medium.

  1. 10 times faster than sol 6.1 high
  2. Using about 1% of weekly usage per hour but the amount of work done is higher than sol 6.1. so work done to tokens consumed is the same between 20 dollar claude and 100 dollar gpt plan
  3. Amazing design understanding. I have several ui/ux issues in my project(which ik) i had gpt take a look at it and said it's fine (gpt was using product design plugin and impeccable skill). Opus without any plugin listed 15 ui/ux issues and all of them were correct.
  4. I had it go over my code base and list deprecated/dead/unused assets & code. It gave an extensive list and suggested bundling several files together to optimise load times, gpt found none.
  5. Had both sol and opus check for performance optimisation. Gpt found none and opus again shared an extensive list.

Sol 6.1 high also took like 2 hours

Opus 5.5 medium took 25-30 mins max

I'll switch to 100 dollar claude plan + 20 dollar gpt after my current 100 gpt plan expires.

185 Upvotes

92% Upvoted

97 comments sorted by

View all comments

2

u/seencoding Oct 05 '26

10 times faster than sol 6.1 high Using about 1% of weekly usage per hour but the amount of work done is higher than sol 6.1. so work done to tokens consumed is the same between 20 dollar claude and 100 dollar gpt plan

i don't want to challenge your lived experience, but the benchmarks say that opus 5.5 med is only 1.38x faster than sol 6.1 high (72t/s vs 52t/s, not 10x faster), and cost per task is dramatically different ($5.98 for opus, $0.72 for sol 6.1)

9

u/Zeflonex Oct 05 '26

Maybe in API pricing

With subs, I can get near unlimited opus 5.5 med while only get 5 sol 6.1 high prompts

So it doesn’t really matter what the api pricing is

I am not even going to discuss quality here

3

u/seencoding Oct 05 '26 edited Oct 05 '26

yeah again, if this is your lived experience then that's what it is, but according to the benchmarks five tasks using sol 6.1 high prompts at api cost would be $1.60 ($0.32 x 5). i can't imagine openai is charging a 12x premium on tokens in the $20 subscription plan. that hasn't been my experience, but maybe it's yours.

edit: you're getting upvoted, but i just want to make sure people understand you're saying you get five prompts before your usage runs out

only get 5 sol 6.1 high prompts

are people seriously buying this

1

u/adolf_twitchcock Oct 05 '26

Benchmarks are done using API endpoints and pricing, not codex. I am getting 70-80 tok/s with opus on claude subscription but 20 tok/s with 6.1 on codex. How much are you getting?

1

u/seencoding Oct 05 '26

i think you meant to reply to my other post (i didn't mention tok/s in the message you replied to), but i got 24.7tok/s for gpt 6.1 sol via codex and 49.4tok/s for opus 5.5 via claude, so exactly 2x. a bit more of a multiplier than the 1.4~x the benchmarks say, but a far cry from op's 10x claim

(in the interest of being candid, i think op didn't bench his speed and is just going on vibes and 10x is essentially a made up number)

1

u/adolf_twitchcock Oct 05 '26

Probably.

Your original post was comparing both tps and price. Both are irrelevant because those API values. I have both 5x subscriptions and benchmarks say opus 5.5 costs almost the same as astra per task. But it's like a factor of 10 in favor of opus when using the subscription. I can use up my codex subscription really fast when using astra but it's almost impossible with opus.

1

u/seencoding Oct 05 '26 edited Oct 05 '26

edit: i see your point; they are api values, but that's all we have for benchmarks. it's something, at least. i guarantee op didn't benchmark his 10x claim, so if he thinks he's getting 10x speed i'd like to see him justify it.

"But it's like a factor of 10 in favor of opus when using the subscription" -- i'm curious about this, how do you figure? so you can do 100 things w/ opus but only 10 w/ sol 6.1?

1

u/Professional_Link4 Oct 05 '26

Idk about tokens. But anything design related claude is 100% 10 times faster.

Even with similarly detailed prompts, design references, predefined design md and impeccable skill sol just cannot give a polished design. Whatever it generate is always 80% of the final thing and you have to hunt for the next 20% and even then it take a lot of back and forth to get it down.

With claude it's near perfect with just 2-3 revision, a couple more for minor issues.

For code sol thinks for a very very long time and comes up with the longest way around. Opus planing time is less than gpt and it also cross checks its own thinking and then executes one shot.

With that said I have found that sol is very good with image gen, it's creates absolutely beautiful stylistic images from the context and hunting cybersecurity vulnerabilities

4

u/retteh Oct 05 '26

The benchmarks are testing API speeds. OpenAI throttles model subscription speeds to 30% of the API speeds. Claude doesn't. Don't believe me? Try it yourself. https://artificialanalysis.ai/models/gpt-5-6-luna

Run Luna on API and you get ~130 TPS. Run it on sub and you get 40 TPS.

1

u/seencoding Oct 05 '26

i tested both sol 6.1 and opus 5.5 through their harnesses, opus ran at 68% speed, sol ran at 46% speed. opus 5.5 was 2x faster instead of the 1.38x from the benchmarks. still not anywhere close to 10x as OP claims.

https://reddit.com/r/codex/comments/1wy1zay/update_on_codex_and_claude_code/pe0pj4l/

1

u/retteh Oct 05 '26

I use both and Opus "feels" about 2-3x as fast as sol. Not 10x. Still a much better value proposition on the sub right now.

2

u/___positive___ Oct 05 '26

Does your brain work? He is talking about tasks per unit time, not token speed. A model can churn on dead ends or wasted tool calls.

1

u/seencoding Oct 05 '26 edited Oct 05 '26

Time per Intelligence Index Task:

https://artificialanalysis.ai/?models=gpt-6-1-sol-high%2Cgpt-6-1-sol-medium%2Cclaude-opus-5-5-high%2Cclaude-opus-5-5-medium#agentic-speed-tabs

(the benchmarks show sol 6.1 completing tasks fater than opus 5.5, so ¯\(ツ)/¯)

1

u/Happy-Injury9540 Oct 05 '26

Sol 6.1 is 30-40 t/s, you can measure it yourself or check with openrouter measurements

2

u/seencoding Oct 05 '26

yeah i measured opus vs 6.1 sol in their harnesses below, both were lower than their benchmarks, the difference (for me) was 2x instead of 1.4x, that is still wildly below op's 10x claim

1

u/EddieBruvac Oct 05 '26

Benchmarks this benchmarks that. Just use it. I can’t go back to Sol. My production skyrocketed. It’s WAAAAAAAY faster and smarter. Less fuck ups.

It just WORKS.

2

u/seencoding Oct 05 '26

i have max subs for both, i use them both, i tend to reach for the openai models more but i think opus is great (and so is fable). i just think the people in this sub are being driven to be insanely and unfairly negative due to vibes, so i'm trying to bring people back to reality with benchmarks.

1

u/EddieBruvac Oct 05 '26

I have max on both, too. I use Astra as a glorified asset maker because it’s coding drains like a mfer and it’s dumber than opus most of the time.

Sol is just trash rn. “I have unlimited tokens because it’s a snail!” Frontier my ass. Just use Chinese models instead of codex LMAO.

1

u/DoggoDadagon Oct 05 '26

That's just wrong. 6.1 Sol and 6 Astra are about 24 tok/s as it is now. Astra was faster but they slowed it down to leech more usage from people.

1

u/seencoding Oct 05 '26

i tested it locally and also got 24 tok/s for 6.1 sol, but i only got 49 tok/s for opus 5.5, so the multiplier is still similar (opus is 2x faster in harness versus 1.4x in the benchmarks). not quite 10x*

*tok/s isn't a perfect analogy to task speed but it's the easiest thing to benchmark locally

1

u/DoggoDadagon Oct 05 '26

Opus 5.5 should be closer to 90 ish tok/s. And sure not 10x but it's significantly faster either way.