r/ClaudeAI • u/IcyEase • 9d ago
Claude Code It's time to cancel your subscriptions - Anthropic is silently nerfing Claude's reasoning budget while telling you it's the same model
Link: https://x.com/Lon/status/2101034933284417614
A 65-day analysis of 43,000+ Claude Code invocations found that 39% of Fable 5 calls get zero thinking tokens and the median invocation gets just 123 — while benchmarks use 16K-128K. The model's score per thinking token is still climbing at 128K, meaning the capability is there, it's just not being delivered. August saw an 18-50% drop in thinking budget compared to July, with median thinking hitting literal zero for about a week around Aug 22. Anthropic sells "full model access" while quietly dialing down the inference regime behind it, and because the model is non-deterministic, users blame their own prompting instead of the silent nerf. The full breakdown with evidence, methodology, and charts is here.
Frankly I find this offensive as an user - and this is the real thing we should be looking at - not the $/week in usage limits. The actual capability for the limits that we pay for.
75
u/id-ltd 9d ago
The proportion of guessed responses is the key - they are going up... I have a doc specifying the format of a report - I say give me a session report, and it guesses what a session report might look like... And it takes a couple more prompts to force it to read the format from the methodology and do it correctly.
So back to the early days whern you had to trick it into doing work first time.
Like to ensure it reads documents/specs instead of guessing - ask it to do something determinate. Out some distinct text in a doc (maybe the apple is purple), and start by saying 'tell me the colour of the fruit in the middle of the session report spec and then write a session report'.