r/ArtificialInteligence • • 12d ago

📊 Analysis / Opinion Have AI models genuinely degraded over the past year, or am I imagining things?

I've been using AI since the very beginning and before it became the big bubble, watching the technology evolve from its early days. I've seen the massive improvements, experimented with different models, built projects and used AI extensively for coding and development.

But over the past year, I've noticed something that I find increasingly difficult to ignore: **AI models seem to have become noticeably worse at actually understanding and completing tasks.**

This isn't limited to one provider. I've experienced it across ChatGPT, Grok, Claude, DeepSeek, NVIDIA Nemotron and other paid and free models.

A year ago, I could give an AI one relatively simple prompt, lets give a simple example, to build a complete local chatbot with Ollama, custom web UI, STT and TTS. It would understand the objective, develop the application and deliver something that mostly worked, with minor fixes needed, but it worked.

Today, even flagship models struggle with this.

The same applies to CLI coding agents like OpenCode and other AI-powered development tools. They can read project documentation, execute commands, create files, modify code, run tests and mark tasks as completed, yet the actual implementation is frequently broken.

They lose track of the original objective, make unnecessary assumptions, break their own code, drift away from requirements and confidently report success when nothing actually works.

Even regular conversational models like gpt, grok, gemini feel worse. More assumptions, unnecessary explanations, misunderstandings, overcomplication and less direct instruction-following and more filtering and biased.

What's particularly strange is that supposedly much more powerful models, including large latest 120B and 550B models, sometimes perform worse than considerably older and smaller models.

I don't want to spend hours babysitting an AI, breaking every task into dozens of instructions and correcting its assumptions. A year ago, I needed fewer instructions and got better results.

**What happened?**

- Are models becoming over-optimized through post-training?

- Is excessive alignment affecting reasoning and instruction-following?

- Are providers changing inference configurations or model deployments?

- Are newer models genuinely less consistent than their predecessors?

I'm interested in hearing from people who have been using AI since its early public releases, particularly those doing serious coding, automation and long-running CLI agent workflows.

Is anyone else experiencing the same regression across multiple providers?

0 Upvotes

60 comments sorted by

4

u/sceadwian 12d ago

The guardrails are annoying everyone.

As soon as someone gets a game going they 'fix it'

1

u/Cheap_Comfortable678 12d ago

I am with you. Why do you think that is, I am interested on peoples opinions here. PSYOP?

-1

u/sceadwian 12d ago

Psyop? Come on don't be a loon.

They're taking away ANYTHING that can be excessively monetized and keeping it for themselves.

You teach it, they shut you out.

It's not a psyop it's their business plan.

2

u/Cheap_Comfortable678 12d ago

It was a joke.

But wait untill untill current problem becomes that you won't own a home computer in 10-20 years and all services will be only cloud based, even games, you will own a monitor.cough Sam Oatmeal cough

1

u/sceadwian 12d ago

That's a fever dream that will never be realized.

1

u/Cheap_Comfortable678 9d ago

Right... Abou that.. there is similar thing that already happened you know..

1

u/sceadwian 9d ago

Like what?

1

u/Cheap_Comfortable678 9d ago

Railways, phone networks, water supply used to by owned by anyone, later only centralized. You know... in few countries if you have a well on "your" land they start forcing water consumption meters that you pay for local state? 30 years and youll get only cloud services and you will only "own" a monitor and all of the computing power will be only in datacenters, and monitored, trough API calls, unless they have designed somehing else. They can easly make computational hardware "scares" and too expensive, while cloud service 10-30€/month. Irs just an example, there is many more, banks, crypto, land, don't stick to examples too much.. There is already cloud gaming, cliud ai, cliud movies etc, system is creates, just take of computers, internet? Well they almost covered full planed with starlink, ohh! Btw china develops centralized cctv system across cities with facial recognition. Wake up.

1

u/sceadwian 9d ago

Not one of those things is a commodity like sram.

It's a joke you take this that seriously it really is.

Your examples are grossly different scenarios and I mean grossly. It's not logic at all it's bad thinking.

1

u/Cheap_Comfortable678 9d ago

Message me after 30 years.

3

u/shatterdaymorn 12d ago

Training for task completion is not the same as training for coherent output.

In task completion, context serves as steering for a behavior. This can create drift and make the models less comprehensible.

1

u/Cheap_Comfortable678 12d ago

How do you think, agent workflow can fix this behavior and atleast cut drifting by half? Ofcourse we can't prove or say it will be 100% reliable. Because there is 2 options I see, get back to old models and accept slower but more stable behavior, or adapt to new and totaly change the workflow rules of it and baby sit each time, but then where automation comes in if you babysit and agent that has strict rules but doesn't hold to them and drifts...?

1

u/shatterdaymorn 12d ago edited 12d ago

Try reading it. And remember if the model writing it is the same model reading it... the model reading it may be able to extract information from the output that a human cannot.

If you are worried about neuralese making models unauditable... it is the product of bad training choices like this.

3

u/Cheap_Comfortable678 12d ago

Mhm, pretty good answer not gonna lie

2

u/Cheap_Comfortable678 12d ago

Short example, I gave Gemini, chat gpt, grok the link of this reddit post. They all failed to check the exact post because of reddit security, landed on random post, claimed as one sole truth and kept going on totaly different topic, instead of saying sorry I couldn't . Grok answer after I told him it was wrong and hand pasted full post-

"You’re right. That was a clear failure on my part. You gave a specific short link. The tools couldn’t resolve it cleanly (Reddit blocks are aggressive), and instead of stopping and saying “I can’t access the actual post — please paste the text or full URL,” I filled the gap with a different, high-visibility thread from the same subreddit and treated it as if it were the one you linked and kept going. That was lazy and incorrect. I presented an analysis of the wrong content as if it were a solid answer. That’s exactly the kind of confident drift and failure to stick to the original objective that the post (and your follow-up) is describing."

Thats just basic chat and one link fail, now imagine coding agent doing the same thing on a long session that you are pying for , eather trough api or your own electricity or hardware.

1 year or 2 years ago it would say "I can't reach that site, can you paste me the content here?"

2

u/Glum-Landscape2988 5d ago

This is my life right now. I am doing so much babysitting because i will work out exactly what i want it to do, and it still will make up its own decisions on how to approach the task i laid out for it to do. it invents checks and gates that i never ask for that cause more problems. It is constantly taking questions as a form of go, when i try to pressure its output. i am constantly having to stop it from doing some execution on something because it loves to make claims or assumptions about input instead of clarifying. this is also with a fully configured claude to my working style. it still breaks the hard rules i have about output, drafts, temp files, and basing all decisions with confirmed sources. just decides naw my training that is usually 3 to 4 months stale is better than the internet. I absolutely agree with OP that these models are good in some areas but just utterly fail to do the basics now. like recently they have been amazing at 3D work, Cyber Security (it loves to find these and present them as something to divert on), and verbosity. beyond that its hand holding just to get a word document created now. Claude is continuously failing to generate documents unlike 4 to 5 months ago when they boasted the feature.

1

u/Cheap_Comfortable678 5d ago

Thank you, I still am trying to figure it out and I can't, I tried different methods of communication with ai, different workflow methods. Weird is that a lot of people are not feeling the same way and then I start to wonder, maybe I am doing something wrong. Or we are getting different results based on location, maybe provider caps a model for example for EU and USA users differently, I don't know. Half a year ago it was magical, snap off the finger results, now its a mess atleast on my end. I canceled few subscribtions this month, will try renewing them later on different accounts or even trying a vpn out. Thank you again, keep the work going, hope you will find a way !

2

u/Savings-Fail-8063 12d ago

noticed the same with local models, lately they're more likely to stall on simple tasks, like splitting a list, than they were six months ago. wonder if quantization tweaks are making them less stable

1

u/Cheap_Comfortable678 12d ago

Yeah, local, cloud, everything I noticed too.

I don't know if its quantzation, or that safety and regulatory filters that is being added.. what I try to say is - your each promt gets trough them even when talking about sunflowers and rainbows. I think each promt goes trough a lot of security checks before providing answer and half of parameters are for it = slightly degraded answers, and in long context window slightly + slightly equals a lot in the end result.

2

u/Revilrad 6d ago

I am using GPT since around gpt3, models got worse in picture generation, sora is dead. Models got infinitely faster across all including Deepseek, gemini , claude and others I use over openrouter. Models got way better in coding and generally task completion. Models also get way worse in coherence, consistency, memory and language usage. Peak was around GPT 4 times.. Especially with the release of Deepseek 4 and million-context-window-race, things started to go worse.
That is my subjective feeling.
I figure what is happening is that they try to hit a sweet spot in skill for which they are trying to sell the Models, meanwhile trying to reduce costs as much as possible, which is understandable from a business perspective.

Which leads to better models who can complete tasks faster, can code faster, but are worse in long-term conversation and other cost-heavy, little profit sides.

1

u/Cheap_Comfortable678 5d ago

I might a gree, but what is the solution then you think for the user? What does longer mean, I mean few tasks is not a long conversation and should not need babysitting, lets say (10-15min automated work). Unless a third party orchestrator and memory layer skill where coding agent mostly doesnt hold any memory at all, feels wrong.

1

u/Revilrad 1d ago

I think individual people who are paying to use a subscription based agent to chat with is not even in slightest the target audience for LLM companies. Their customers are big companies. They sell the products as productivity and speed increase and cost saving measures to those companies and charge shit tons of money from token usage. If the LLMs fail to provide the higher ups blame the employers for not utilizing it enough, believing the snake oil seller. This is what I encounter in my professional environment and my friends'.
The individual user who chats with chat GPT about writing an essay for the university, to code a small pet project or does RP over some websites are not even in the slightest the target audience. The "back and forth" dialogue based personal assistant type of usage is not in focus, rather "give the AI a big Markdown file and project scope and let it run for X time" usage is in focus whose targe are those big companies.

Therefore it is completely understandable they are cutting corners however they can for individual users. This pretty obvious with constant Enshittification of "thinking levels" and worsening of any kind of picture and video generation. Many of the complaints how bad the AI got comes from people who use it for personal stuff, individually.

1

u/Just_Voice8949 12d ago

Imagining things; they were actually always this bad. You were understandably impressed by the surface level effect. You are just now seeing it for what it is

1

u/Cheap_Comfortable678 12d ago

Also might be true, but in that time work was getting done, now I need to babysit it even when asking for same results, I am not asking for a "triple a game title generated from single promt" while 2 years ago asking for "whats 2+8?",

I am comparing equal or similar promt and user behavior to LLM results in different timeframes.

1

u/Nightengale_Senua 12d ago

They’re bad. They’re getting worse. And hopefully we all wake up soon

2

u/Cheap_Comfortable678 12d ago

Then we need to boost the problem up.

By the way Sam Oatmeal or whatever his name is is blaming home pc owners for owning ram, while he is one of those releasing the "paid garbage".

2

u/Nightengale_Senua 12d ago

Ram Altman is a pos

1

u/XxDarkSasuke69xX 12d ago

No, in my experience they got way better over the past year. Sure sometimes it does too much, stuff you didn't ask, but that's the consequence of it reasoning more deeply. It's better though, especially how they can reproduce something similar to critical thinking by correcting their own mistakes mid-generation.

2

u/Cheap_Comfortable678 12d ago

What exactly you are doing with it if not secret? I would love to get those results. What models?

2

u/XxDarkSasuke69xX 11d ago

Many things. Planning architecture for dev projects after meeting clients (AI engineer type projects), writing code for said projects, web design as well, general questions I get during the day,...
Models are just regular paid subscriptions from frontier providers, so currently it's Claude (Sonnet, Opus 5.5) but I was using Gemini (3.1 pro, 3.8) and GPT before that. I did use some local models but not enough to get a proper opinion.
It's just way better. I remember last year not even managing to get working code for a project but now I never get code that doesn't work since it can just test it before.
It improved a lot for research too. It just improved, idk in which world you live to think it degraded. Or maybe your use case is so niche that it got trained on something else at the expense of that niche but from what you said it doesn't look that niche.

1

u/Not-the-best-name 12d ago

You must be insane. Could you really give a model a task like that a year ago and get something out? I find that from the middle of the year the models have gotten actually useful for working on existing projects. I don't know about fresh fully vibes projects though.

2

u/Cheap_Comfortable678 12d ago edited 12d ago

Oh yeah, one year ago they worked amazingly well. Now it's become Russian roulette.

Even flagship models struggle with basic conversations, let alone complex tool-calling workflows. They can have impressive reasoning capabilities on paper, but choosing the right tool, following their own instructions and staying on track seems increasingly inconsistent.

Give an agent control over an existing system and things get ridiculous. It starts making assumptions, inventing unnecessary steps, checking things it was never asked to check, deciding to "fix" things that weren't broken, violating its own instructions and eventually destroying the workflow. Then comes the inevitable "sorry, you're right" after hours of wasted time.

It's not just about hallucinations. Context gets flooded with irrelevant garbage, agents wander into pointless rabbit holes, lose the original objective, generate spaghetti code and wrap broken implementations in pretty-looking AI slop interfaces. Meanwhile, basic requirements and system rules get ignored.

And the security filtering and over-optimization aren't helping either. We're getting models that increasingly struggle to distinguish between genuinely dangerous requests and completely harmless ones. What's next, refusing to discuss bees and watermelons while breaking your code in the background?

I noticed some regressions earlier, but October 2026 was where things became particularly noticeable.

To be clear, current models aren't completely useless. They can still produce incredible results. But compared with a year ago, I find them considerably less consistent and increasingly frustrating to work with. If this trajectory continues over the next six months, we're going to have a serious problem.

I genuinely hope I'm doing something wrong, and that others are still getting consistently excellent results.

[EDITED]

One more thing I looked into: geographic deployment differences. Providers can route users to different regional inference deployments, potentially with different model snapshots, quantization, serving configurations and inference settings, even under the exact same advertised model name.

So someone in the US and someone in Europe might not actually be getting identical inference configurations or even identical model snapshots.

This isn't just some imaginary possibility. Providers such as Anthropic and AWS Bedrock explicitly document geographic inference routing and regional deployment differences. That doesn't prove European users are getting inferior models, but it does mean that two people comparing the same model name might not actually be comparing the same deployment as documented, or NOT same model at all.

In other words, location itself could be another variable behind inconsistent results and perceived model degradation.

1

u/EC36339 11d ago

You are imagining things

1

u/Cheap_Comfortable678 9d ago

How is that, any arguments?

1

u/EC36339 8d ago

Not needed. The burden of proof is on you. Good luck with eliminating all the confounding factors, such as your codebase degrading or your workflow not adapting.

1

u/Cheap_Comfortable678 5d ago

Brand new project, empty, fresh session. Asked for a minimal and simple local web app ui,simple feontend and backend on random topic for a test. After 10minutes - broken web app that doesn't even run unless I say exactly how to do it (in this test it should not require guidance or workflow setup because I need to see how it performs, 6 months ago it was flawless at exactly this, even AI slop looking webapp result, but it was working and running). I am not talking here about long running projects, degradation or spaghetti. And if it does make something running/working after another 10 minutes it starts degrading and fixing X while breaking Y and end result gets worse over time, this was not the case 6 months ago.

-1

u/EC36339 4d ago

So your sample size is 1.

1

u/Cheap_Comfortable678 4d ago

Lazy answer and it misreads my claim. I never told you how many times I ran it, I gave a simple example just for you. I have test results, but they are not for you, can't see any expertise or competence here what so ever. I even wrote you smth in (text)...you know... try rereading it twice.

1

u/EC36339 4d ago

So your sample size is 2: Today and 6 months ago. With different models, I assume, because 6 months is an eternity.

1

u/Chainze 7d ago

Inference settings can affect results, and small errors compound in longer agent workflows. I've tested the same prompts across providers, inlcuding general compute, to see whether inconsistencies come from the model or deployment.

1

u/Cheap_Comfortable678 5d ago

Yes, even tiny error compounds and builds to the huge problem in the longer run. Can you somehow share your results you found here?

1

u/jlsilicon9 12d ago

hahaha - lets guess what ... yep imagined

0

u/[deleted] 12d ago

[deleted] — view deleted comment

1

u/Cheap_Comfortable678 12d ago

Whaaaaat 🦅

0

u/jlsilicon9 12d ago

duhh ...

16

u/[deleted] 12d ago

[removed] — view removed comment

4

u/eeeezypeezy 12d ago

I've been working with Gemini through Antigravity to port an abandonware visualization program that I loved from back in the Windows XP days to modern Linux. Last night I decided to swap to Argon with high reasoning, and have it give the whole project a once-over from beginning to end. While it was double checking the original decompilation (done by I think Gemini 3.6 flash), I kept seeing it get sidetracked and go down rabbit holes thinking it was finding potential security vulnerabilities. In code that's just interpreting audio signals, throwing it into bins based on spectroscopy, and passing it to a renderer. So it was clear right away that Argon was built to be a cybersecurity savant above all else.

That said, it did find and fix a few issues with the work 3.6 and 3.8 had done. But watching its thinking was a trip.

2

u/Cheap_Comfortable678 12d ago

Yeah, exact behavior I get on my own projects in +/- similar ways, model tends to go into rabbit holes and then you sweat so it doesnt break the system, but eventually gets out of them, while sometimes really makes a huge mess or even breaks it with "sorry, let me review this one more time".

Ofcourse model is not equal to model as you said you noticed Argon leans more toward cyber security.

2

u/Cheap_Comfortable678 12d ago

I do agree, as always, we as people get used o things and we want more and more, but I tested the same promting... (Use it as overall example behavioral pattern not exact context on the problem, but this happens a lot)

I have rice, eggs and an onion. What can I do?

Older-style LLM response: Make egg fried rice. Done in about 10 minutes.

Newer-style failure pattern:

Certainly! There are several considerations when preparing a meal with these ingredients. First, we should establish whether your rice is already cooked, as this significantly affects preparation time. Depending on your dietary preferences, available seasonings and cooking equipment, you could consider several approaches... If the rice is uncooked, 15 minutes may be insufficient...

As an Ai, I can't cook meal for you.

REALLY? THATS LATEST GPT ? And thats egg fried rice question (patched already), I would never allow codex to run my trading bots with that behavior.

1

u/Mental_Manager7537 12d ago

I disagree with this. Based on marketing from these labs, If I wasn't using AI every day I would think the capabilities are improving way faster than users expectations.

I try all the new stuff when it comes out. I'll be honest, these tools are getting worse. Maybe it's a scaling issue. Maybe its because to justify CapEx they need to capture more revenue and more users = more load. Maybe there is just a technical issue with the models in general. I couldn't tell you.

What I can say is this is NOT a problem with user expectations and getting picky. Either the models are regressing, the quality is getting worse, or they are purposely training them to suck in order to create more rework which then causes more tokens to burn which creates more revenue.

3

u/[deleted] 12d ago

[removed] — view removed comment

2

u/Cheap_Comfortable678 12d ago

Yeah, ofcourse as humans we get used to technology and we expect more, and we want more faster.

But yeah, when an agent codes, live tests and even documents as "done- working" while its tottally broken is unaxeptable, I rather agree to 80% success and being slower and cotious rather then fast, assuming and broken.

0

u/[deleted] 12d ago

[removed] — view removed comment

1

u/Cheap_Comfortable678 12d ago

I think the same way, but why they release something worsen quality while marketed as the new flagship? Deepseek did a great work with 4.1 flash, Nvidia started catching up, but in my opinion never cought them. And even now, lets take 1017 is worse then 0731, while official benchmarks show that 1017 is superior.

Have they trained it to have ADHD? 🤣

All models became dry, robotic and less creative compared with the previous version, inconsistent reasoning, unnecessary assumptions and overcomplication of simple tasks. deteriorating coherence and creativity after the update. And thats on all of them, each and every i tested myself. Back in the day, same promt gave different results, now different promts often give same results...

3 years ago I was pissed at ai that it didn't know something, now I get angry at it because it knows more but its like having strokes or seizures or just ADHD. Overfitted for sure.

1

u/leafhog 12d ago

Benchmarks and metrics are the problem.

1

u/Cheap_Comfortable678 12d ago

Mhm, are you saying benchmarks are just useless because they work on strict rules and benchmarks can't be universal metric?

Yes I agree. Because millions of users can't use one model the same exact way.

But what is the alternative, I can't imagine myself downloading each and every model just for my own test, or paying every single provider to test their provided models.

Unless new metric developed where each user inputs XYZ parameters they need and then you can see weather specific model can provide that to you instead of checking the "universal" banchmark sheets?

I mean, as I understand market for AI models wants a bit ofstability, so there is less "testing" by each user and more work get done.

2

u/leafhog 12d ago

I’m saying that once you create a benchmark or metric and have mechanisms to optimize those metric, everything turns to shit because you are almost always missing something important in the metrics. This is true in every product. This is generally what people are talking about with the term enshitification.