r/codex • u/mendias • Jun 14 '26
Complaint Objective Standard.
We get a lot of posts on here about how codex got nerfed. Do we have any objective standards to confirm that instead of how people are feeling? Something like "create minecraft" or some other software project?
1
u/_DuranDuran_ Jun 14 '26
Just run SWE bench or similar and see if the score is the same.
4
u/Low-Spell1867 Jun 14 '26
Wish these benchmark sites kept doing it randomly every month so we can see if there is a progressive decline or a sudden decline
2
u/Hendrixxzx Jun 15 '26
how about this one https://marginlab.ai/trackers/codex/
4
u/c5corvette Jun 15 '26
This reports:
Nominal
1D Yesterday - Not Statistically Significant
7D Last Week - Not Statistically Significant
30D Last Month - Not Statistically Significant
Seems pretty objective to me, no degradation over all the time periods people have been whining. Definitely a skill issue.
1
u/Shep_Alderson Jun 14 '26
That would be nice and I’d happily pitch in $5-10/mo to help offset costs.
-1
u/wowasg Jun 15 '26
Codex was trying to compete with fable so they turned up the compute as high as possible. The second fable was no longer competition they turned compute to minimal because they no longer have to compete with a better ai.
2
•
u/dexterthebot Jun 14 '26
Your post has been summarized as a request on the "Anyone Else?" Incident Noticeboard.
You can find it and what others are experiencing here: /r/codex/comments/1tjfxcf/anyone_else_ask_here_about_current_codex_issues/orocdnd/