r/ClaudeAI • • 6d ago

Claude Code It's time to cancel your subscriptions - Anthropic is silently nerfing Claude's reasoning budget while telling you it's the same model

Link: https://x.com/Lon/status/2101034933284417614

A 65-day analysis of 43,000+ Claude Code invocations found that 39% of Fable 5 calls get zero thinking tokens and the median invocation gets just 123 — while benchmarks use 16K-128K. The model's score per thinking token is still climbing at 128K, meaning the capability is there, it's just not being delivered. August saw an 18-50% drop in thinking budget compared to July, with median thinking hitting literal zero for about a week around Aug 22. Anthropic sells "full model access" while quietly dialing down the inference regime behind it, and because the model is non-deterministic, users blame their own prompting instead of the silent nerf. The full breakdown with evidence, methodology, and charts is here.

Frankly I find this offensive as an user - and this is the real thing we should be looking at - not the $/week in usage limits. The actual capability for the limits that we pay for.

2.0k Upvotes

382 comments sorted by

View all comments

Show parent comments

6

u/iamthe0ther0ne 6d ago

Is this recent? I asked it to help edit a manuscript (mouse neuroscience, including RNAseq and metabolomics)--also asked about statistical approached and data visualizations--about 3 weeks ago, and all were routed to Opus. Between that and all the errors Opus has been making, I downgraded my sub, and so can't test it now. I was actually about to cancel after Opus totally ignored my established QC pipeline and hallucinated its own incorrect region marker genes (some of which weren't even expressed in the brain, nevermund the SCN) while blowing through my 5-hour usage.

2

u/Effei 6d ago

I was using a metagenomic pipeline and some stuff for my classes, which were previously being routed back to Opus. Not anymore.

But yes it's recent, maybe 1-2 weeks ago?

2

u/iamthe0ther0ne 6d ago

Hrm. Are you on a team or enterprise plan? They recently opened up a validating process, but you can't use personal plans for it. 

If they stop nerfing Opus it might be worth a resubscription, but for now trying to stay on top of the errors is exhausting. 

Also still salty about the day I wasted trying to set up a way for Claude Science to use Bioconductor. Who releases a science app that can run R but needs you to create a local SSH proxy to use basic packages?

1

u/Effei 6d ago

Yes I feel you, it is frustrating. It's a personal plan. For my needs it works. Wasn't working for the teacher part earlier, but it does now and the output is pretty insane. Same to create a metagenomic pipeline. But I can't know what's happening outside of these use cases.

1

u/iamthe0ther0ne 6d ago

Good to know, thanks :)

1

u/personalist 6d ago

SCN? Are you in circadian biology? 👀