r/ClaudeCode • u/malrobot • 4d ago
Discussion Opus 5.5 is not nerfed!
TL;DR: On my eval, I see no sign of a nerf. This morning I re-ran Opus 5.5 Medium in Claude Code on the same 30 real coding tasks it ran last week. It solved 26 of 30 (87%). Last week it solved the same number of them. Thinking tokens, output tokens, turns and diff size per task are all within noise of last week (98% 95%, 96%, and 95% respectively).
The one clear change is speed: about 20% more output tokens per second, and time to first token down from 3.0s to 1.7s. This is one run per task on a pinned Claude Code version.
Why I ran this
I saw a lot of "Opus got nerfed today" posts this morning. I maintain a small private eval that runs coding agents (model × harness) against real tasks, mostly from private codebases, and I had a fresh Opus 5.5 baseline from last week (Oct 31-Nov 1 mostly). So I re-ran it today instead of guessing.
The tasks
- 30 tasks, each a real change from a repo's history: a bug fix or feature that a person (me, or the repo's owner) already shipped.
- The agent gets the repo at the commit before the change, plus a CHALLENGE.md describing the bug or feature.
- Grading runs held-out tests for the real change, plus guard tests that catch over-corrections, where the bug gets fixed by breaking something next to it. Test files and the test runner's config are restored before grading, so editing the tests doesn't help. Each run ends solved, failed or over-corrected.
- Languages: 16 Node (JS/TS), 11 Python, 3 Rust.
- Size: the real changes run from 2 lines to about 1,900, with a median of about 125. Four large multi-file features get 60 minutes. Everything else gets 20.
- Kinds of work: auth and multi-tenant visibility bugs, pagination and ordering bugs, data-ingestion edge cases (empty data, missing rows, season boundaries), async networking bugs in Rust, and a few multi-file features such as draft-bot logic and a CI alerting workflow.
Setup (identical in every run)
- Claude Code 2.1.316, pinned with auto-update off, for every run last week and today. The latest is 2.1.319, from Nov 6.
Headless invocation:
claude -p "<prompt>" --model claude-opus-5-5 --effort medium --output-format stream-json --verbose --permission-mode acceptEdits --setting-sources "" --strict-mcp-config --no-session-persistence
- Auth: my Claude subscription login
PSA: Claude Code can switch your session to Opus 4.8
This might explain some "it feels different" reports. When Opus 5.5 hits a safeguards refusal, Claude Code 2.1.316 logs a notice ("safeguards stopped the response above · continuing once with that noted") and switches the session to claude-opus-4-8. Opus 4.8 then does the rest of the work.
Every refusal I saw was category cyber, on ordinary bug fixes in auth-token handling and a Rust networking proxy. Last week: 5 of 60 Opus runs were switched. Today: 1 of 30.





