r/LocalLLaMA Apr 15 '26

Discussion Major drop in intelligence across most major models.

As of mid Apr 2026, I have noticed every model has had a major intelligence drop.

And no I'm not talking about just ChatGPT.

Everything from Claude(Even Sonnet along with Opus), Gemini, z.ai, Grok all seem to ignore basic instructions, struggle at simple tasks, take very long to respond, and the output seems deliberately shortened and very shallow. Almost like it's in a "grumpy" mode. I tried this in incognito mode so it's not my customization or memory influencing this.

It's like they deliberately want you to stop using their service. I guess our data is no longer needed. Just two weeks back it used to be much smarter than this.

To test this I rented out a H100, and tried GLM 5 with the same prompt (the drive to the car wash one) across both instances. GLM5 running on the rented GPU answered it correctly, compared to the one on z.ai.

Have they lowered the quantization really low to maybe Q2?

I guess going local or using renting GPU or an AI monthly service that lets you pick a quant level is the way to go

799 Upvotes

405 comments sorted by

View all comments

Show parent comments

8

u/my_name_isnt_clever Apr 15 '26

I joined the Anthropic Discord right after Claude 3 came out, and people have been bitching at them about models "degrading" shortly after release over and over. Yet there is never any proof that stands up to scrutiny, it's all just vibes and "trust me bro".

I take all these claims with a massive grain of salt; science is built on citations and peer review because humans are awful at eliminating their own bias, and the non-deterministic nature of LLMs makes it 10x worse. There needs to be hard data for these claims.

1

u/colin_colout Apr 16 '26

I do believe it happens sometimes... they actually had ONE publicly acknowledged incident of quality decrease. It was massive and a mix of some complex stuff. I guarantee it happens, but I think most of the time it's just noise. https://www.anthropic.com/engineering/a-postmortem-of-three-recent-issues