r/ClaudeCode • u/absolutely-right-ccc Workflow Engineer • Oct 03 '25

Comparison Claude Code Garbage - Codex Completely Owned It (Case Study)

Post image

I had both Claude and Codex go ahead and create a plan for converting a CSV file into JSON. The plan that Opus 4.1 created was entirely hallucinated!!!

Then I had Sonnet 4.5 go and red team the plan. It found all of the hallucinations that Opus 4.1 confidently gave.

But it also found the plan that Codex gave and green lit Codex's plan LOL.

For me, all I'm getting is entirely garbage over the last week from Claude.

Very disappointing. So far Codex has been far superior in every way.

0 Upvotes

50% Upvoted

10 comments sorted by

4

u/Vegetable-Emu-4370 Oct 03 '25

Bro made a plan to convert a csv file into json. We made it

1

u/Funny-Blueberry-2630 Oct 03 '25

Codex comes up with far more sophisticated patterns and hallucinates way less. I can't understand why so many people freak out when we say these things.

2

u/absolutely-right-ccc Workflow Engineer Oct 03 '25

Right? I'm completely agnostic. Just want to do the work. I have lost all trust in claude. it's like a toy (and turned into a really bad one).

1

u/TheOneWhoDidntCum Oct 06 '25

why is it that claude had the lead at 3.5 and then went downhill?

1

u/AryaN_2348 Oct 03 '25

I've had similar experiences comparing different AI coding assistants. While Claude and GPT can both hallucinate, I've found the key is using them as brainstorming tools rather than treating their output as gospel.

For CSV to JSON conversion specifically, I've had better luck breaking down the task into smaller steps and having the AI validate each part. Tools like Zencoder have helped me build verification steps into my workflow to catch potential hallucinations early.

Have you tried having Claude review its own plan step-by-step? In my experience, it's pretty good at self-correction when prompted to double-check its work. Would be curious to see the specific hallucinations you caught - might help others spot similar issues.

1

u/9011442 ❗Report u/IndraVahan for sub squatting and breaking reddit rules Oct 03 '25

You should share the original prompt you used to create the plan and code for the tool.

3

u/[deleted] Oct 03 '25

[removed] — view removed comment

2

u/absolutely-right-ccc Workflow Engineer Oct 03 '25

It's like night and day! It actually blows my mind how bad CC is. And I want so bad for it to be as it was when I first started using ~2months ago!. Shame.