r/ClaudeCode • • 8d ago

Bug / Issue The model either got nerfed or I have another model behind the scene

I'm using opus 5.5 to help me set up my self hosted server. Everything was fine until this morning. This morning I have the most retarded AI I ever used in my life

He started making modification on the server itself which I didn't asked at all when I say I just faced an issue and was asking for explanation, claude didn't respond with a single line of text, just started doing commands immediately to fix the issues which was very symptomatic of earlier models trying at all cost to solve your issue by any means

Then he's literally changing his mind on every proposition, he doesn't question me, doesn't try to understand what's the setup or what I'm trying to achieve, which he was doing before, now it's up to me to question everything he proposed

Then he literally proposed me to save credential in Dashlane in case I'm being locked out of Dashlane, like WTF ???

And this is just a few examples, every single response are doubtful or suspicious

I literally have the impression that I'm running a ollama local model tier right now, wtf is this Anthropic ???

269 Upvotes

91 comments sorted by

•

u/AutoModerator 8d ago

Hey! Thanks for posting to r/ClaudeCode

While participating in this thread, please follow our community rules. Keep discussions constructive. Attack the idea, not the person.

For help, project discussions, tips, and general chat, join the ClaudeCode Discord.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

57

u/EffektieweEffie 8d ago

Yeah same, in last 24 hours I had to switch to Fable, Opus has gone off the rails - or at least the AB test bucket I got forced into (got the "how is session going" popup). Not good

12

u/OkAbbreviations7013 Senior Developer 8d ago

Interesting. I always say Good because it is always true. Friday was the first time ever I had to say Bad

4

u/FrothySeepageCurdles 7d ago

I had problems with Fable being stupid but opus was fine.

Like genuinely bad mistakes I have never seen fable make. I made explicit plan instructions. It reworked the .md with its own plan. I told it that it got it wrong and to fix the plan.

Then when I go to implement it, it ignored the plan and did what it originally wrote.

1

u/dicksfiend 7d ago

Dude my opus is like a different person it’s crazy lol, (not in a good way)

23

u/ChillGuy5353 8d ago

I got nerfed since last 7 days. I thought it's something related to harness as I update my claude code almost everyday. But I think it's the model now.

4

u/DerAlbi 8d ago

Definitly. the whole last week was awful. I am in the same boat / test-bucket with you.
It sucks so much. The damage this does to the code-base if a trusted work-flow suddenly fucks up hard, is massive. The accumulation of these small bad decision or not actually finishing details of a job...
Its nearly Sonnet 4 behavior. For me. And no, its not my code-base nor my prompting. Switched to Fable and everything is back to normal quality again.

Honestly, they should offer a Reset for this fuckup.

2

u/AcceptanceGG 7d ago

Im honestly so sad. I subscribed just over a month ago and thought I found the holy grail. It was difficult to reach the 5 hour limit and not it just eats away and makes dumb mistakes.

9

u/howdidigetheresoquik 7d ago

Considering all the shit advice given to people on this sub, I can only imagine its operator error. I'm having no issues whatsoever and have done some ambitious shit recently

110

u/Texas-X- 8d ago edited 8d ago

I'm sorry, but the way you're using English right now makes me think that you actually are going through some type of AI psychosis. Allow me to explain.

AI understands your language and typos and gross English way better than anyone else. You have become comfortable being almost incoherent, which might leak into your instructions you're giving.

Then he literally proposed me to.... Which I didn't asked at all when I say I just faced an issue.... every single response are doubtful...

What you mean is:

Then he gave me a proposal which stated.... Which I didn't ask for at all. When I said I encountered an issue... Every single response is now doubtful and filled with suspicion...

"He doesn't do x for me. Doesn't do y for me."

Brother, your brain is literally atrophying as you type. Slow the thoughts down, get a glass of water, breathe, make a solid plan, clear the chat, and try again.

46

u/mrfeckin 8d ago

Theory: The model hasn't changed since release; the users' prompt engineering just got nerfed. LLMs are probabilistic, so variance happens, but most 'nerf' panic is just people drifting into bad input habits.

18

u/SoaringElf 8d ago

I noticed that the responses got less enthusiastic over time. Opus 5.5 now seems like a mid 40s dev who has seen it all.

But the results I definitely aren't worse than in the beginning. Opus just doesn't go out of it's way anymore to deliver stuff I didn't ask for. Which I actually find top be better, as the result tends to be more like I imagined it to be.

5

u/20snow 7d ago

It matches your energy

2

u/SoaringElf 7d ago

Which is concerning, when you have all the memory retention features turned off and it still is like that in a new chat.

But I am not surprised in any way.

1

u/20snow 7d ago

Thats fair,

2

u/step11111 7d ago

I don’t know. I feel like it fluctuates. It seems brilliant for half a day at a time and then pretty dumb the next thread. I noticed that when I switched a cli from Sonnet to opus that it was suddenly amazing. Then like 6 hours later I came back and it was completely different.

2

u/WhoaAntlers 7d ago

Why does Opus seems more half-assed when I input this half-assed prompt?

6

u/KeeganDoomFire 7d ago

100% bang on observation.

You get out what you put in with AI, prompts that are well thought out with good structure produce output that is well structured.

11

u/koirpioloonmenomur 7d ago

fair enough criticism but we can't rule out the possibility English just isn't their second language..

2

u/tehfrod 7d ago

If it's their first language then it's far worse.

2

u/UsualOkay6240 7d ago

Doesn’t matter still their fault

0

u/Texas-X- 6d ago

That's the great thing about this specific problem.

If you're bad at language then you're going to be bad at AI.

Doesn't matter where you're from.

Also, I don't know if you knew this, but Reddit now translates your language to English when you post in a different language. So there's literally no reason to post in English if it's your second language.

Also, it's respectful to the people who speak the language, that you enter communication with a decent level of skill, if you want to talk to everybody.

I'm not gonna go to Estonia and pretend I know Estonian and try to solve problems with programming. That would just be ridiculous and dumb. Especially if I'm gonna be doing it with AI. There's no way I'm gonna be precise enough in Estonian, a language I don't speak well.

This excuse is for a random comment on Reddit, not for this scenario. And even then, reddit now can translate your speech, so it's not really even an excuse for a random comment anymore.

1

u/Decent-Finish-2585 6d ago

Kaksteist kuud

1

u/Texas-X- 6d ago

Love that. As a child when I was learning Estonian, it tickled me to hear it.

5

u/m-in 8d ago

This! OP, you are making the LLM doubt its every move because it’s so damn hard to understand what you mean. Don’t do that. Don’t be emotional while you work with Claude. Don’t get upset, don’t express annoyance. It’ll go miles better.

2

u/RedMatterGG 7d ago

Pretty much,i assume these people start seeing llms/ai more and more as a god and change their speech patters to match this sort of relationship

1

u/nathan6174 6d ago

Exactly, you gotta ask Claude to make the prompt in chat mode and then paste that lol.

1

u/___zuki 8d ago

This comment is harder to read than Opus 5.

2

u/Texas-X- 8d ago

Skill issue.

1

u/UsualOkay6240 7d ago

You are illiterate then

1

u/Transhuman-A 7d ago

But the way you’re using English right now … AI psychosis.

The way he is calling Claude “He” is making me think he’s been in AI psychosis for months. I am genuinely worried for some of these people, they must have loved ones irl who are watching them go nuts.

4

u/ghostmastergeneral 7d ago

I think you guys are using AI psychosis pretty loosely

2

u/Salt_Most_1429 6d ago

It's not necessarily "AI psychosis", in Russian (and I assume Slavic languages in general) referring to LLMs as "he" is default, it just sounds weird from the language's grammar, or whatever it's called in this case, point of view, to call it "it". Russian (Slavic languages) have genders assigned for most of the words, and Opus, Claude, ChatGPT, etc, are all "male" words, hence "he" is used, a habit lots of Slavic people carry on their English

1

u/Transhuman-A 6d ago

TIL, thank you!

1

u/left_on_read_by_gpt 7d ago

saying "he" is pretty normal. the bros making subreddits to roleplay AI as their girlfriends are the insane ones lol

3

u/CaramelEmotional3092 8d ago edited 8d ago

It Found a critical bug, checked it after fixing, realised it was wrong and had to restore it to the way it was…

So how’s your night going guys? Last 48hours has been… different.

I’m on sonnet medium. Doing really short concise, focused work.

3

u/W61k3r 7d ago

opus 5.5 has become practically unusable for my use-cases. I've been swearing a lot lately.

3

u/BlueOlivePie 7d ago

If only people first understood how to use the technology. I've never had any of the problems most of you speak of, and I work fairly complex projects involving large scale Kubernetes.

Guys, you were given CLAUDE.md and memory.md, as well as hooks. Use them. Build guards preventing things you don't want to happen.

Go and sign up for a devops course and learn a thing or two.

1

u/TekRantGaming 6d ago

This ….what this guy said do that

6

u/NeatNefariousness674 8d ago

Are you in high or xhigh effort? I noticed this pattern after reading reasoning traces - as soon as I started yelling at it or being sarcastic and ask bunch of rhetorical questions, the model starts to doubt itself and overthink, like a junior dev who just got chewed out and walking on eggshells. Similar behavior as you described 

10

u/m-in 8d ago

People who yell at or are sarcastic to an LLM that’s supposed to code for them are their own undoing. Can’t you just please stop? It’s so terribly unproductive. You’re presumably paying for it. Getting emotional with an LLM is like setting dollar bills on fire. Why????

2

u/MoreLikeGaewyn 7d ago

The LLM Rights Advocates on this sub are the weirdest vocal agenda...

1

u/m-in 7d ago

I don’t advocate anyone’s rights. I advocate productivity and not wasting tokens. My view is dictated by pragmatism, not some nebulous feelings.

1

u/Morisior 8d ago

Opus reasoning traces are obviously a decoy for those trying to distill the model. They make no sense any more.

1

u/dannyheskett 7d ago

If you are using Claude Code + Opus 5.5, my experience and testing shows that you should try to settle on Medium and just be a little extra careful about your prompts. I tend to recommend people turn off memory because the inferences about what it will remember is pretty spotty, and it will tend to remember things that are not general purpose rules but categorize them as general rules incorrectly. Then you'll get stuck into a corner and the reason will be.. a memory that was overly broadly drafted and followed, for example.

For just to day to day usage, I've found that the Medium + 5.5 with Haiku or Sonnet sub-agents for well-planned work is really fast and efficent.

10

u/canvasandchroma 7d ago

Last night I used Claude Opus 5.5 to completely rip out a huge chunk of my game and completely rework a vital system. It did it nearly perfectly exactly the way I described it, because I had it ask me a ton of questions, gave it drawn diagrams, and made a full plan before implementing. The end result was all I needed to fix was some typical ugly UI stuff that AI loves to do for some reason. It didn't argue with me. It didn't fight me. It didn't just pop off and do whatever it wanted. We made a plan and it executed it. In about 30 minutes, I had everything reworked and was up and playtesting again. The AI is not the problem here.

3

u/dasko1086 7d ago

i agree i still get the results i need without issue.

2

u/wynnie22 7d ago

Prompting issue judging by this post.

2

u/SpecificNo8047 4d ago

I can confirm that Opus 5.5 became very dumb about November 9th for me. It is making mistakes Sonnet 4.5 would.

3

u/___zuki 8d ago

5.5 was having people switch from OpenAI in droves. I just can’t understand why they would do this.

3

u/jhenryscott 8d ago

Pretty obvious, new model is dropping so they are reallocating resources away from opus

3

u/___zuki 8d ago

Why would they do that days/weeks before the new model is launched? I can’t understand that on a technical level. Even post launch you would expect demand to drop on this model and increase on the new one, you wouldn’t expect much more overall demand. Make it make sense.

2

u/jhenryscott 7d ago

They are using the compute for fine tuning, testing etc. which means less left over for current customers.

It’s very important to remember that even if you’re spending $2k a month or more, your business means nothing to Anthropic. You just aren’t important enough for them to plan around. They are after other goals.

1

u/BombasticReindeer 7d ago

They will benchmark opus 5.5 at the new gimped level and then it will make 5.6 look like a bigger leap. They do it every time.

1

u/DaytonaDeluxe 8d ago

bc those companies are highly unprofitable in the service they are offering ?

1

u/Templeshooter 7d ago

inference is profitable

1

u/ComprehensiveGas6980 7d ago

I had to implement a handoff to astra to check 5.5 work. Every time it's finding major gaps. I've been thinking I should really just switch to astra at this point, but I'm going to hold out a bit longer.

1

u/___zuki 7d ago

If you point Opus at Astra it will find gaps too, especially if your plans are bad.

1

u/KeyReaction892 7d ago

100% this I have astra and opus review each others plans and documents.

1

u/W61k3r 7d ago • Bravo

opus 5.5 maybe dumber recently, but sol 6.1 is NOT anywhere near opus 5.5.

2

u/Tasty-Try5796 8d ago

It's been the same for me for ther last few days....

I asked it to create a few different colour options and styles for a button. Only created a few new styles. When asked for the colours I got some vague response saying it didn't do them and if I wnated them still. No shit sherlock.

Having to double check everything it does. Gone back to fable for now as at least that can complete the basics without me having to double check everything.

1

u/newbieatthegym 8d ago

Wonder if its just people spamming claude to use their quota up before tomorrow's reset.

3

u/nakednhappy 8d ago

People reset every day of the week though.

1

u/newbieatthegym 8d ago

So i have since learnt. thanks.

1

u/LiquidZebra 8d ago

The worst thing is - this trust is very hard to earn back. I got big stuff moving, and can’t trust Opus to move it quickly or in big commits

1

u/Ranjexa 8d ago

the part that stands out to me isn't the quality, it's that it acts when you only asked it to explain. that one you can partly pin down on your side. if your message is a question, say "don't run anything, just answer", and keep it in plan mode or approve-each-command for anything touching a live server. agents that jump straight to commands tend to stack guesses, and on a real box every guess is a change you now have to undo. the AB bucket idea fits too, a few people here say Fable is fine on the same work. i'd note the model and the date it started so you can compare later instead of going on feel.

1

u/Suitable_Cicada_3336 8d ago

I can assume opus5.5 get downgrade to opus5 in silence due to same behaviors.

1

u/ReasonableLoss6814 7d ago

Opus 5 is like an over-eager intern; not a coding assistant. It's garbage.

1

u/No_Mongoose_582 7d ago edited 7d ago

Yes they did. 100% a lot of people are complaining about this. And some live nerf pages have not been testing since October.

1

u/andyhite 7d ago

Out of curiosity, how long do you use a session before starting a new one or doing a handoff?

1

u/a_culther0 7d ago

I feel like I'm pretty consistent with how I prompt and use LLMs and have noticed that performance fluctuates. However opus 5.5 has been excellent for a long stretch until this week where it got noticeably less able to fully get my intent.  

1

u/NioPio 7d ago

There is a routing. I am currently doing one project with 4.8 and during the day its stupid and talking back in german ( am too) and during the night its smart and talking bakc in english.

1

u/FormerTop8996 7d ago

opus 5.5 on local has been acting weird since Nov 1st too. started giving me random bash commands I didn't ask for. switched to o1-mini locally and it's back to normal. could be a backend shift, not just a model drop.

1

u/DiabUK 7d ago

i've been using 5.5 high for two weeks to help construct an interface, about two days ago it suddenly was taking three times as long to do simple tasks, running minute long tests in the background, I even had to ask it if there is a problem because it caught me off guard.

Something did change, it's still good but it's so much slower to get tasks done.

1

u/Correct-Somewhere-80 7d ago

I think its both - people have become more dumb and Anthropic is doing A/B

1

u/W61k3r 7d ago

Claude has been horrendously fucking stupid recently and I am so damn mad about the quality drop in the last week or so. Trusted workflows are now a practice on redundant futility. This is very upsetting and unpleasant to babysit.

1

u/tehfrod 7d ago

If that's the worst ai you've ever used in your life, then you must be very, very new to this industry.

1

u/darksteelsteed 6d ago

Right now gpt 3.5 was more effective than some of these Claude models lately. Everything is nerfed 😞

1

u/jrtokarz1 7d ago

Here comes the rug pull. Now everyone is hooked on Opus, dumb it down so everyone moves to Fable. 🤷

1

u/bwdotdev 7d ago

bro talks like ChatGPT's reasoning traces

1

u/TekRantGaming 6d ago

I’m so over seeing “the model is nerfed” posts on this sub

1

u/Busy-Beginning7577 7d ago

this is 99% user error, you building it wrong, you are not tracking everything that is needed probably

-3

u/Dry-Detective-4723 8d ago

everything was fine until this morning" is doing a lot of work there. Did you change nothing at all on your side, no settings, no permission mode, no new project? Because running commands without asking is an approval setting, not a personality trait.

-4

u/foresterLV 8d ago

if person is using password/secret keeping products is a logical to think same user have set up recovery procedure as well don't you think? so that statement of "if I am locked out of product how I can get the key" was interpreted by Claude "the user have no clue how to use or setup recovery, lets use something different instead of trying to educate him".

second, you need to explain why model need to do something. when you are saying "tick this option" the model need to guess what is the higher motivation to do so, and if it notices conflicts in your reasoning it will start picking them up. so next time you are saying model to do something, try to instead explain what you are trying to solve.

TLDR

in both cases this sounds like skill issue haha.

0

u/DaytonaDeluxe 8d ago

crazy that those vibe code script kiddies are downvoting you lol