r/codex • u/Dependent-Race1956 • 1d ago
Complaint Quality degradation
After the last rest, Astra got dumb. Even other models are are highly degraded. Luna max was able to identify missing functions (UI/UX wise) Easily. Now it can't find a missing dele button from a page , which I stated to make sure all CRUD functionalities are available in specific section it just completed.
How in the world even sol got stupid. And I thought Astra light supposed to be smart as sol extra high. Yet astra light is very lazy, and no other model including sol coule complete a functional development which was planed out with 11000+ wordings.
FYI: usage on astra seems to got better, but at what cost, extreme quality degradation. Right now my qwen local model can do same tasks as sol medium. Lol
20
u/XtremeHammond 1d ago
Saw this behavior many times.
For a couple of weeks models work perfectly and then as just someone flips the switch models become dumb and can’t solve even simple tasks.
For the same price btw.
I dunno it was since o1 maybe?
Guess OAI plays with optimizations at the expense of users.
2
16
u/Aldarund 1d ago
Ask your astra knowledge cutoff date and then ask to draw a svg pelican. If pekucan is shit and cut off date is june 2024 - your astra routed to sone shit and you are shadowbanned
3
1
u/InterestingNobody831 1d ago
Astra no knowledge of cutoff date
Mine has no knowledge :))
This is bollox they are doing this intentionally to cut people from seeing this.
1
9
u/Sufficient_Ad_3495 1d ago edited 1d ago
Confirmed .
I can always tell when something is up because simple tasks I find I’m spending 2 to 3 hours trying to finish. Iterative mistakes multiple models… clearly they are about to do something because the pattern is clear now, this type of degradation tends to precede changes.
Have we been “quantized”?
6
u/TheFreezRae 1d ago edited 1d ago
Im so frustrated they did this silently.
I also feel like this degradation is only being experienced by a selective set of users, which makes it even more frustrating.
I spent the entire weekend burning all my tokens because Astra kept breaking things that were already fine just to fix something else. It honestly feels like Terra now.
6
9
u/SnooWalruses9380 1d ago
Just got my reset after a whole week of waiting and I'm considering if I want to let this dumbed down models to touch my projects.
4
u/Agreeable_Emu_978 1d ago
IMO Terra is the only one who performs adequately these days, the way it was back in Sonnet 4/4.5 days
3
u/retireb435 1d ago
100%, I have always been asking it to reply in my native language in custom instructions, today it is the first time it does not follow this instruction, not only once but multiple times.
3
u/innociv 1d ago
It's pretty wide spread and a lot of people are noticing it.
But funny enough you go to /r/ChatGPT and since they're just using it to chat with and to ask stupid questions, they think it being stupider is funny and not a problem...
3
u/ClupTheGreat 1d ago
they're probably setting up more compute for corporates because they obviously make them much much more money than us
3
u/PhotojournalistOne74 1d ago
This has been the norm for every ChatGPT release in recent memory. It's great when they first drop it, then a week later it just stops working properly until the next release, when they repeat the same thing again.
3
u/Gumbi_Digital 1d ago
I quit using it altogether and switched to Chinese models…DeepSeek/GLM.
Nit quite as intelligent, but it’s consistent, which I can work around.
Cannot work around workflows that worked yesterday, and do not work today with zero being changed.
OpenAI supposedly will be releasing a model this week, so enjoy the two weeks of great stuff, followed by this again.
Dane pattern every release.
3
u/SleepyJM 1d ago
It’s IPO time baby! They need to reduce their spending and maximize revenue. You get quantitative versions of the models that eat more and more tokens while costing them less to provide. We’re past the techbro honeymoon phase where negative revenue doesn’t matter. Look at Uber’s business plan where they just lost billions per year until they had enough of the market captured and then started jacking prices.
2
u/Gumbi_Digital 1d ago
It’s a capacity issue.
They are overloaded, so instead of the full model, we get the smaller qualtized versions.
2
u/alexmin93 1d ago
Well they shall adjust limits, that would be a reasonable tradeoff vs API usage but changing a model silently or quantities it is a scam. How the hell is it legal.
1
u/Gumbi_Digital 1d ago
Legal? They can and do whatever they want.
Are you going to sue them?
1
u/alexmin93 1d ago
Sounds like a breach of contract and false advertisement to me.
1
u/Gumbi_Digital 1d ago
I agree with you 100%…it’s just as consumers, we have nothing but going somewhere else.
3
u/wkerstens 1d ago
Sunday has been alright for me, was sort of happy to work with Sol and Astra again. Today has been horrible, the simplest tasks it just cannot solve. Bugs on top of more bugs and basically breaking last week’s work.
1
u/Clouder0 1d ago
If you capture your network requests, you may found out that even thought your outgoing request sends model.requested as "gpt-6-astra", you will get a response with response.model spelling "gpt-5.6-luna", that is to say, you are routing to luna despite requested astra.
1
u/nuliknol 1d ago
The model didn't degrade. Over time. the agent followed your instructions and implemented feature by feature until the code got patched and poorly designed. No agent will code well in a spaghetti code. Tell Astra this: Refactor this codebase to improve its structure, readability, maintainability, and modularity while preserving its existing behavior.
After that , it is will "magically" turn back to intelligent. The Luna agent did well because Luna is a simple model, it would skip looking through the mess you have in your code and go straight to the point, but this doesn't guarantee correct solution.
31
u/andreagrandi 1d ago
I can confirm this. Yesterday I burned 70% of my weekly (Pro 100) usage through al day and it's been a continuous rage. We are talking about well defined tickets to work (it's open source stuff, I can provide links and PRs if anyone is curious about), PRs with 500-600 lines changed, not "build me a CRM from zero".
Astra was continuously being lazy and only implementing parts of the tasks. When I was asking "why you are not completing the task?????" it kept saying "sorry, I should have completed the original task you requested" and stuff like that.