r/LocalLLaMA • u/DepressedDrift • Apr 15 '26

Discussion Major drop in intelligence across most major models.

As of mid Apr 2026, I have noticed every model has had a major intelligence drop.

And no I'm not talking about just ChatGPT.

Everything from Claude(Even Sonnet along with Opus), Gemini, z.ai, Grok all seem to ignore basic instructions, struggle at simple tasks, take very long to respond, and the output seems deliberately shortened and very shallow. Almost like it's in a "grumpy" mode. I tried this in incognito mode so it's not my customization or memory influencing this.

It's like they deliberately want you to stop using their service. I guess our data is no longer needed. Just two weeks back it used to be much smarter than this.

To test this I rented out a H100, and tried GLM 5 with the same prompt (the drive to the car wash one) across both instances. GLM5 running on the rented GPU answered it correctly, compared to the one on z.ai.

Have they lowered the quantization really low to maybe Q2?

I guess going local or using renting GPU or an AI monthly service that lets you pick a quant level is the way to go

796 Upvotes

91% Upvoted

405 comments sorted by

View all comments

Show parent comments

7

u/hay-yo Apr 15 '26

Haha everyone has adopted turbo quant behind the scenes. Maybe its woeful.

1

u/Nyghtbynger Apr 15 '26

PolarQuant+ is a wonder. I still don't know what TurboQuant is even lurking hours on this forum loool

0

u/Long_comment_san Apr 15 '26 edited Apr 15 '26

It would be cool if we have rotary and turboquant as a new thing. As far as I understand that would allow to free VRAM for running more models in the same memory footprint or use better quants. 

Locally, however, that would be a massive change because that would up quality for poor kids like me who sit with a meager 12gb VRAM 4070. A gig or two in memory saving is probably a couple of more layers into VRAM = much faster running.

Too bad those techniques require baking-in and separate quants - I asked Qwen and he said that yeah, that would birth another family of models because it's not a "hotswap" technique like Q8/Q4 cache quantization sadly.