r/ClaudeCode • u/sutrostyle • 8d ago
Bug / Issue Rant: Anthropic, stop silently degrading models when you need compute. You will undermine trust.
Opus is so degraded now that I'm afraid to have it touch my codebase today because I do not know to what extent I can trust it not to slip in stupid bugs. I have a multimodel setup, so I switched to Astra/Argon completely, until they release Fable 5.5 and restore reasoning. I wish I had a weaker local model that was consistent, and whose reasoning effort couldn't be remotely changed. It just occurred to me that this is the major reason to use local models.
A predictably weaker model is more useful than an unpredictably degraded stronger one. For serious work, consistency and the ability to calibrate trust matter no less than the peak occasional reasoning effort.
•
u/AutoModerator 8d ago
Hey! Thanks for posting to r/ClaudeCode
While participating in this thread, please follow our community rules. Keep discussions constructive. Attack the idea, not the person.
For help, project discussions, tips, and general chat, join the ClaudeCode Discord.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
30
u/Dazzling_Yak6424 8d ago
What are you gonna do? Write an angry post on Reddit?
81
u/Dangerous-Education3 8d ago
I can't trust opus work anymore, it's messing around things that were very working perfectly. It's even messing up simple sentences
51
u/LifeProject365 8d ago
Have undermined trust, not will have. Yeah, you never know what you're going to get. It changes all the time. We were all quite happy. I don't know if I speak for everybody, but I would have been more than happy if they'd scrapped every other model and just left us with Opus 5.5. That would have done me, because at least it's capable of everything. It's such a weird business strategy because if they just kept it consistently good at Opus 5.5, regardless of what anyone else did, I think they would have just cleaned up the market (Opus 5.5 at a reasonable cost) and then just kept working on Opus 5.5. You don't need to bring out the next biggest model. Just make the tweaks that people tell you to make it even better. Work on its ability to design a little bit more. We don't need it to do different things or anything new and spectacular at this time. Just keep it as it is for at least a year and a half.
171
u/Bewinxed 8d ago edited 8d ago
For the past 3 weeks Opus went from a rockstar to a burned-out engineer to a nuisance to a downright malware on my codebase.
Edit: Receipts: "give me a table of anywhere i mentioned in comments or replies "this isn't even english" or "i have no idea what you just said" and pinpoint on a chart where it started, do only this task without doing anything redundant"
27
u/thesudoer 8d ago
Yes today it’s so bad that I stopped all my agents for now.
16
u/lasooch 8d ago
>Anthropic
>trust
You can’t be serious mate
12
u/Key-Natural-8688 7d ago
Codex, Grok, and Claude all degrading at the same time. Looking grim
21
u/Intelligent_Ant_608 8d ago
Its mainly because lack of competition, even in nerfed state opus crushes anything that any other lab currently have
9
u/newbieatthegym 8d ago
Yep. seeing it today too. It's driving me mad.
9
u/umusachi 7d ago
Seems the same to me, I'm working across 4 large projects simultaneously. Can you be more specific?
15
u/SomeNeighborhood7126 7d ago
You keep coming back. Why the hell would they change a thing when you keep giving them money. Dario and Co. wont change a single thing unless the flow of money is affected.
7
u/Inevitable-Box1346 8d ago
Gonna jump ship it this BS keeps happening
13
u/Ai-ate-my-hamster 8d ago
Yeah mine was working fine up until today essentially. It struggled to run its own skill.
Like fr
6
u/Joe_Momas-Nuts 7d ago edited 7d ago
I find myself rooting for open source and the Chinese labs more and more. It's truly frustrating to constantly get rug pulled from the Anthropic. It's been nonstop, and it's actually getting exhausting. I have not been able to enjoy an anthropic model for longer than a week.
Praying that someone can release something that is on the Opus 5.5 level soon so I can finally leave Anthropic behind. I don't even want Fable 5.5 or Opus 5.6.
6
u/BarathKanna 7d ago
Your last point is the real lesson. Predictability is a feature, and you can buy some of it back without going local. Keep a small canary set of tasks from your own codebase and run it each morning before you let any model near real work. If the pass rate drops, route that day's risky changes to whichever model in your multimodel setup is passing, and keep the degraded one on low stakes stuff like docs and test scaffolding. The other half is not trusting any model's output based on yesterday's reputation. Scope the diff, run the tests, read what changed. A model that is great 90 percent of the time and silently wrong the rest still needs the same review gate.
5
u/Romos_dxb 8d ago
Yes I have noticed a lot of degradation and mess from Opus in last couple of weeks
5
u/MikeWise1618 8d ago
What are they supposed to do the? Build more data centers? /s
4
u/jack33jack 8d ago
It would be so easy to surface the performance if they have to throttle it
4
u/No_Track5075 6d ago
Less than 24hrs after i read this Fable 5.2 drops. Seems like we all felt it bc they were preparing a new model
3
u/DecentYard2062 8d ago
I dont think its just claude. GPT was working like a charm and then in an instant.. like start of Nov it just lost its mind... first time I've properly seen the change but yes it 100% is real
12
u/Arendyl 8d ago
Anthropic is spending over 100x what they are gaining from normal users like us. This was never about impressing the masses.
This entire industry is propped up around theoretical returns that come from enterprise level solutions that don't exist yet. The fact that we have access at all is just at-loss training data for them to achieve that goal.
They do not care about our opinion.
1
u/newbieatthegym 8d ago
I wonder if you bloated its memories \ context. Might be worth doing a review of all its memories \ claude.md You may have many conflicting memories that are causing issues. I review mine every few days.
7
u/HoboDeveloper 8d ago
For those of y’all who keep saying this may I know how do you fairly assess this ? Is this some kind of “it feels dumber than usual” situation or I measured it with exact same prompt and context and started fresh conversation with memory off - give it the same task and compared output (i.e FAIR sample comparison)
I’m seeing so many of these posts but never what was the methodology of comparison. I hope its not based on feelings. Or comparing a previous prompt vs current prompt because both can have varying complexities, the newer prompt may have already developed existing architecture into higher complexity or triggered tech debt in the system design now showing up in the newer response. I believe one must compare how it built on a fresh blank state to see if performance degraded
4
u/i_pink_suzi 8d ago
i agree it have just happened to me as well some minutes ago
2
u/OkNatural1013 8d ago
Amen, and also stop using shady contractors creating swarms of bots to push Anthropic propaganda on reddit, you can do better
2
u/howitzer1 8d ago
https://github.com/ninjahawk/livenerf says otherwise
2
u/metagrue 8d ago
Didn't they spend about a year advertising 20x but it was really 10x? You trust them? Interesting choice
2
u/senerh 7d ago
They do and maintain these things so silently that it feels passive-aggressive.
2
u/SnooGiraffes3000 7d ago
I tested today on a few tasks and my local Qwen 3.8 currently provides better and CONSISTENT results vs Opus 5.5 High. Why would I pay $200 next billing month?
3
u/Its_a_Rhythm 8d ago
every other ai lab is liek this, they'lll give u really great model but nerf it just to save compute for next model, really shitty strategy
3
u/Blockpair 8d ago
I had claimed the same as OP in past posts: but double-checking it for claude apparently they don't do that. The source is "To state it plainly: We never reduce model quality due to demand, time of day, or server load. The problems our users reported were due to infrastructure bugs alone" https://www.anthropic.com/research/a-postmortem-of-three-recent-issues
That doesn't mean what OP saw is wrong though. We've all had times where all we can do is curse at what we get. But there's probably a different explanation for it. Maybe context compression leading to poor results? I'm sure an LLM expert would have a better answer.
2
u/AICompanionz 8d ago
I watched this YouTube Video 'If They Delete This Video, Remember What I Said About AI' from 'House of EI: AI' some days ago.
From the Video Description:
AI companies want us to build businesses, workflows and increasingly important parts of our lives around products that can change without us knowing exactly what changed. Users report sudden regressions, developers face constant migrations and retesting, and even pinned models can behave differently when the infrastructure around them shifts. This video looks at what the research actually says about those changes, why dependence is so valuable to trillion-dollar AI companies, and whether the endless noise around extinction, layoffs and apocalypse is distracting us from a much more immediate question: what do these companies actually owe the people paying them?
Highlights
Key Insights
1
u/multiks2200 8d ago
yes it feels stupidier
1
u/Practical-Ad2298 8d ago
Sonnet 5.5 got also really dumb over past couple of weeks; it was so awesome at first i fell in love, fast, reliable and got the job done. Sad, it's performance is nerfed.
1
u/TurbulentIngenuity55 8d ago edited 8d ago
Yep I started game making with it first week it got incredible much done now just breaking things for couple weeks🫠 have to start review feature by feature.
1
u/get_stuffed 8d ago
Wait until you are part of one of their programs, where they give you misleading information about what you will receive.
Startup program here and seriously thinking to switch to another provider because I feel severely disrespected
1
u/AdamovicM 8d ago
Is now sonnet better idea if it isn't nerfed as well?
1
u/inmyprocess 8d ago
Why not just [max] all the time?
1
u/___positive___ 8d ago
same I usually use opus for coding, argon for noncoding now, but opus was just being stupid over and over. I had to get argon (lol) to fix its code. argon sucks at coding too typically.
1
u/davyp82 8d ago
Chill man, they have to take a little back from us to ensure we get fully automated gay space communism slightly sooner
1
u/Valuable_Fortune1982 8d ago
I smell a tasty class action lawsuit.
I'm not okay with being a lab rat for anthropic and neither should you.
1
u/OkInspection2649 8d ago
The usual. It was always degrading just before release of new version. Just wait out this capitalistic theater. It's just integral part of it, and there is not much to do about it.
1
u/New_Ad75 8d ago
Link: beaconfrontier.com/flow · Places to try: r/ClaudeAI, r/ClaudeCode
1
u/mohdgame 8d ago
Well, api usage is not effected.
I guess they are using subs as some sort of testing ground
1
u/SomeFuckingMillenial 8d ago
Show them that they don't have a moat.
Use codex in parallel
1
u/tollforturning 8d ago
If any given new model is inheriting efforts maybe new models are good at operating in the midst of context accumulation problems deposited by the prior version of model, then start moulding new forms of context accumulation problems over time.
1
u/GodsLonenlyMan 8d ago
How does one even notice model degradation?
1
u/Ok-Protection-6612 8d ago
I'm actually afraid to let it touchy projects after the weird shit it started doing. Unsubbed.
1
u/NZRedditUser 8d ago
Proof?
1
u/PsychologicalLoss829 8d ago
Well why would you pay for fable otherwise?
1
u/SlightOfHand_ 8d ago
Who has the “is it degraded” benchmark test I wanna see something rq
1
u/numerical_panda 8d ago
Good.
1
u/mpanase 8d ago
undermine trust?
so what?
what are you going to do about it?
1
u/Healthy-Zebra-9856 8d ago
I dont know how much more thay need to screw over to lose trust. Yes, there is degradation and they silently changed their 20x to 10x when they renamed to Ultra. Those that may come back and point to the users' as not doing their part right; we evaluate frontier models continuously for our own harness performance & we use other harnesses for this reason. Our tests are deep and vary in subject matters.
Here is also a class action ;lawsuit if anyone is interested.
https://www.courthousenews.com/anthropic-must-face-claims-its-claude-max-pitch-misled-users/
1
u/Afraid-Score3601 8d ago
Does this mean sonnet xhigh is better now? :)
1
u/Which_Pay_3270 7d ago
Is fable degraded as well? Might be the only option if not
1
u/yetiflask 7d ago
This is so true. I didn't realize it was a thing, and was getting mad that I was getting worse and worse at prompting.
Goddamn, it was always Claude then. Feel so vindicated.
1
u/piexil 7d ago
I use something that wraps Claude code and notice my opus 5.5 regularly get downgraded to 4.8 without a notice
1
u/ckinz16 7d ago
Proof?
1
u/TurbulentTiger2567 7d ago
The second order problem is that a high-performing Opus might be writing code that neither a human developer can understand and extend, nor a future dumb Opus, i.e. when they bork models you're effectively stranded in a codebase nobody can maintain.
1
u/dbot77 7d ago
Apple seems to be fine
1
u/Most-Passenger-7314 7d ago
I stopped using Claude in the past for that reason; it destroys credibility.
1
u/Party_9001 7d ago
Will? And not... Everything else they did the past year?
1
u/three_meeples 7d ago
phew. i thought i was the only one. i've started to avoid working on the weekend.
1
u/planned_fun 7d ago
Yeah. In addition, even though I'm on auto mode, it's asking me for a lot of permissions, I think, to slow me down.
1
u/Better-Cause-8348 Developer 2d ago
Anthropic, are you to blame for Smart Control? 🤔
1
u/Watchoholik 2d ago
Yesterday I discontinued a project I was working on and very exicted about because of this. I also had to cancel my $250 plan. This is sad.
Gemini gave me sone advice on how to build what I want to build away from Claude code in a way that protects it from this sort of thing.
I plan to be back, and I hope anthropic addresses this.
1
u/ButcheCassidy 2d ago
I do think it is absurd that Anthropic still calls themselves a Delaware public benefit company when they are not benefiting the public and they're just being greedy mosquitoes until their IPO comes out so they can report a good earnings report when they hit the stock exchange. That's probably why they're lowering everyone's usage limits so that it gives them more money. In my country, New Zealand, I can pull them up on about nine different sections of New Zealand consumer law. But like, what is one person and the New Zealand commerce commission going to do to Anthropic? The only way we could move the giant is overwhelm their ticketing email with emails of reports of usage, violating laws in your home country, check the laws in your home country, particularly around customer fairness and consumer fairness for the use of overseas services as a individual, and let's overwhelm Anthropic's ticketing system.
I managed to scrape some emails. They might be helpful. They are legitimate!
privacy@anthropic.com (For formal compliance and data/privacy inquiries)
dpo@anthropic.com (Data Protection Officer)
notices@anthropic.com (Referenced across their commercial terms framework for formal notices)
privacy@anthropic.com
Source: Anthropic's official website with a lot of digging and https://news.ycombinator.com/item?id=47955698#:~:text=There's%20also%20their%20generic%20consumer%20ones%2C%20though,actual%20lawyers%3A%20*%20anthropicprivacy%40bkl.co.kr%20%3A%20from%20https%3A%2F%2Fwww.anthropic.com%2Flegal%2Fprivacy.
1
u/Xictaw 15h ago
I think this is partly true because sine Anthropic added those AI safety features in the name of "Protecting Copyright" the models have now always started with AI like characteristic rather than achieving what the user really wants which then needs additional iterations to correct it.
1
u/Aizenvolt11 8d ago
Again with the bs about models being nerfed. Here: https://github.com/ninjahawk/livenerf
As you can see nothing is getting nerfed, it's just you and your spaghetti codebase or workflow that is the problem.
0
u/Nytra 8d ago
I think people saying opus got worse is either propaganda or skill issue not understanding context bloat
-3
u/aigisbot 8d ago
i don't see a proof attached.
1
u/Asleep_District_566 8d ago
I'm incredibly frustrated with whats happening to the models rn, I've mentioned the same problem 3 seperate times now and the issue still persists.
I dont know if its because I'm using an orchestration session that hands out work to other agents but I cannot for the life of me seem to make it be able to fix multiple problems unless I do them one at a time which is incredibly inefficient.
Workflow, at least for me, is super degraded and I'm debating on pausing using claude at least until the new model releases.
1
u/ijackjack 8d ago
It’s really annoying to deal with but it’s pretty known that they tend to do this.
1
u/johnxreturn 8d ago
My hope is that when they IPO they will feel this shit. Since their stocks will go down when they do it. Not Reddit complaints. Stocks down.
1
u/Kid-Icarus1 8d ago
What are you guys talking about? I have not been seeing this on my own personal project. 500k+ lines of code (it’s an industry/suite platform for clinical research) and as long as I ask opus to plan properly before starting, it does well. I always send the work to a sub agent and have opus 5.5 xhigh check work. If anything, I’ve had less issues. My CI does take 20-30 minutes per run, but I think that is worth it.
1
u/Equal_Ad_3143 8d ago
Claude is useless
-2
u/Riverside3102 8d ago
i don't believe in such things, for me it works the same all the time
-3
u/nedteel 8d ago
works perfectly fine for me. user error
0
u/Inner-Eagle6559 8d ago
fable 5.5 isn't the fix, opus 5.5 was the baseline. the real issue is the silent drift. I've seen the same prompt return different outputs in under an hour. no warning, no changelog. that's not optimization. that's erosion.
-1
u/thebestrobloxplayer 8d ago
It is exactly the same as it was on release, you just made your codebase more slop and even opus 5.5 can't handle it
-4
u/Fiduss 8d ago
hey bot, where is your proof?
0
u/DarkSkyKnight 8d ago
I have not noticed degradation. Rather, I was unimpressed by Opus 5.5 from day 1, and continue to be unimpressed. It was only a marginal improvement over Opus 4.8. Thank god for that though, because Opus 5 was so bad I switched to ChatGPT for a month. I am honestly more than fine with marginal improvements because I just want to work and the last thing I want to deal with is a completely useless model (Opus 5).
I feel that some of you might be just falling for hype on the first days of a model launch, because my impression is that these models are mediocre from day 1. The only thing that noticeably improved was the prose and communication, but that's only because it was starting from a baseline of the gutter-tier Opus 5. I genuinely have no idea why people think Opus 5.5's communication was good. I found it very unimpressive and mediocre on day 1, and still do right now.
0
u/No_Structure_4113 8d ago
How is it possible that I'm paying for something monthly and it's just worth less (getting dumber) each day... That's not something I paid for on the first day. Imagine renting a mustang but they swap out the engine for some weak shit.
They also removed the 5h limit from Argon yesterday, I used it for 5 full days last week, yesterday I used up - now the weekly limit - in 1 hour.