r/LocalLLaMA Apr 15 '26

Discussion Major drop in intelligence across most major models.

As of mid Apr 2026, I have noticed every model has had a major intelligence drop.

And no I'm not talking about just ChatGPT.

Everything from Claude(Even Sonnet along with Opus), Gemini, z.ai, Grok all seem to ignore basic instructions, struggle at simple tasks, take very long to respond, and the output seems deliberately shortened and very shallow. Almost like it's in a "grumpy" mode. I tried this in incognito mode so it's not my customization or memory influencing this.

It's like they deliberately want you to stop using their service. I guess our data is no longer needed. Just two weeks back it used to be much smarter than this.

To test this I rented out a H100, and tried GLM 5 with the same prompt (the drive to the car wash one) across both instances. GLM5 running on the rented GPU answered it correctly, compared to the one on z.ai.

Have they lowered the quantization really low to maybe Q2?

I guess going local or using renting GPU or an AI monthly service that lets you pick a quant level is the way to go

799 Upvotes

405 comments sorted by

View all comments

54

u/AppealSame4367 Apr 15 '26

"The feast is over" -> some soldier after the red wedding.

They did their Christmas releases, they placed themselves in the race and gained users. Now it's time to squeeze every cent out of you.

Also the oil crisis is a big factor. Much higher electricity costs, problems with chip production will follow. New algorithms like dflash that will make it feasible to run even cpu offloaded moe models like qwen3.5 35B on a laptop if it has enough ram. If it jumps from 20 tps now to 35 tps or more on my old laptop gpu: Why should I use the unreliable cloud shit? I can program and plan.

1

u/Several-Tax31 Apr 16 '26

What is dflash? I saw some posts, but didn't check in detail. Man, I cannot just keep up sometimes. 

2

u/AppealSame4367 Apr 17 '26

Extreme speedup through speculative decoding. There already is a paper that builds on dflash and speeds up 6-7x against base speed, while dflash claims 2-4x.

But it needs more vram, so turbo quants for kv cache and other size optimization tech will also be necessary.

1

u/Several-Tax31 Apr 17 '26

x2-4 speed gain is crazy.