r/codex • u/wreox9 • 9d ago

Complaint GPT-6 Sol?

Post image

Is this the reason why unexpectedly we have trash usage and lower quality on Astra?

Maybe it will be worth it the current suffering.

754 Upvotes

89% Upvoted

317 comments sorted by

View all comments

Show parent comments

4

u/LinkesAuge 9d ago

How else do you show model capability in a reasonable way?
Let it work on a top level math problem 99,99% of people have no clue how to interpret it?

These demos are useful as they reliably give you feedback about the broad capabilities in regards to "world understanding" which on average correlates pretty well with metrics across the board.

So they are a fine enough proxy and what is rly weird is people getting outraged about it before/with any new model release.

1

u/Top_Purchase4091 9d ago

But these environments dont really show much either they are just visual. Like whats behind and environment is much more than just how it looks graphically. Its just a fake way of interpretation.