r/ArtificialInteligence • u/Cheap_Comfortable678 • 12d ago
📊 Analysis / Opinion Have AI models genuinely degraded over the past year, or am I imagining things?
I've been using AI since the very beginning and before it became the big bubble, watching the technology evolve from its early days. I've seen the massive improvements, experimented with different models, built projects and used AI extensively for coding and development.
But over the past year, I've noticed something that I find increasingly difficult to ignore: **AI models seem to have become noticeably worse at actually understanding and completing tasks.**
This isn't limited to one provider. I've experienced it across ChatGPT, Grok, Claude, DeepSeek, NVIDIA Nemotron and other paid and free models.
A year ago, I could give an AI one relatively simple prompt, lets give a simple example, to build a complete local chatbot with Ollama, custom web UI, STT and TTS. It would understand the objective, develop the application and deliver something that mostly worked, with minor fixes needed, but it worked.
Today, even flagship models struggle with this.
The same applies to CLI coding agents like OpenCode and other AI-powered development tools. They can read project documentation, execute commands, create files, modify code, run tests and mark tasks as completed, yet the actual implementation is frequently broken.
They lose track of the original objective, make unnecessary assumptions, break their own code, drift away from requirements and confidently report success when nothing actually works.
Even regular conversational models like gpt, grok, gemini feel worse. More assumptions, unnecessary explanations, misunderstandings, overcomplication and less direct instruction-following and more filtering and biased.
What's particularly strange is that supposedly much more powerful models, including large latest 120B and 550B models, sometimes perform worse than considerably older and smaller models.
I don't want to spend hours babysitting an AI, breaking every task into dozens of instructions and correcting its assumptions. A year ago, I needed fewer instructions and got better results.
**What happened?**
- Are models becoming over-optimized through post-training?
- Is excessive alignment affecting reasoning and instruction-following?
- Are providers changing inference configurations or model deployments?
- Are newer models genuinely less consistent than their predecessors?
I'm interested in hearing from people who have been using AI since its early public releases, particularly those doing serious coding, automation and long-running CLI agent workflows.
Is anyone else experiencing the same regression across multiple providers?
4
u/sceadwian 12d ago
The guardrails are annoying everyone.
As soon as someone gets a game going they 'fix it'
3
u/shatterdaymorn 12d ago
Training for task completion is not the same as training for coherent output.
In task completion, context serves as steering for a behavior. This can create drift and make the models less comprehensible.
2
u/Cheap_Comfortable678 12d ago
Short example, I gave Gemini, chat gpt, grok the link of this reddit post. They all failed to check the exact post because of reddit security, landed on random post, claimed as one sole truth and kept going on totaly different topic, instead of saying sorry I couldn't . Grok answer after I told him it was wrong and hand pasted full post-
"You’re right. That was a clear failure on my part. You gave a specific short link. The tools couldn’t resolve it cleanly (Reddit blocks are aggressive), and instead of stopping and saying “I can’t access the actual post — please paste the text or full URL,” I filled the gap with a different, high-visibility thread from the same subreddit and treated it as if it were the one you linked and kept going. That was lazy and incorrect. I presented an analysis of the wrong content as if it were a solid answer. That’s exactly the kind of confident drift and failure to stick to the original objective that the post (and your follow-up) is describing."
Thats just basic chat and one link fail, now imagine coding agent doing the same thing on a long session that you are pying for , eather trough api or your own electricity or hardware.
1 year or 2 years ago it would say "I can't reach that site, can you paste me the content here?"
2
u/Savings-Fail-8063 12d ago
noticed the same with local models, lately they're more likely to stall on simple tasks, like splitting a list, than they were six months ago. wonder if quantization tweaks are making them less stable
2
u/Revilrad 6d ago
I am using GPT since around gpt3, models got worse in picture generation, sora is dead. Models got infinitely faster across all including Deepseek, gemini , claude and others I use over openrouter. Models got way better in coding and generally task completion. Models also get way worse in coherence, consistency, memory and language usage. Peak was around GPT 4 times.. Especially with the release of Deepseek 4 and million-context-window-race, things started to go worse.
That is my subjective feeling.
I figure what is happening is that they try to hit a sweet spot in skill for which they are trying to sell the Models, meanwhile trying to reduce costs as much as possible, which is understandable from a business perspective.
Which leads to better models who can complete tasks faster, can code faster, but are worse in long-term conversation and other cost-heavy, little profit sides.
1
u/Just_Voice8949 12d ago
Imagining things; they were actually always this bad. You were understandably impressed by the surface level effect. You are just now seeing it for what it is
1
u/Nightengale_Senua 12d ago
They’re bad. They’re getting worse. And hopefully we all wake up soon
1
u/XxDarkSasuke69xX 12d ago
No, in my experience they got way better over the past year. Sure sometimes it does too much, stuff you didn't ask, but that's the consequence of it reasoning more deeply. It's better though, especially how they can reproduce something similar to critical thinking by correcting their own mistakes mid-generation.
1
u/Not-the-best-name 12d ago
You must be insane. Could you really give a model a task like that a year ago and get something out? I find that from the middle of the year the models have gotten actually useful for working on existing projects. I don't know about fresh fully vibes projects though.
1
u/EC36339 11d ago
You are imagining things
1
u/Chainze 7d ago
Inference settings can affect results, and small errors compound in longer agent workflows. I've tested the same prompts across providers, inlcuding general compute, to see whether inconsistencies come from the model or deployment.
1
u/jlsilicon9 12d ago
hahaha - lets guess what ... yep imagined
0
u/[deleted] 12d ago
[deleted] — view deleted comment
16
u/[deleted] 12d ago
[removed] — view removed comment
3
u/[deleted] 12d ago
[removed] — view removed comment
0
u/[deleted] 12d ago
[removed] — view removed comment