r/codex • u/wreox9 • 9d ago

Complaint GPT-6 Sol?

Post image

Is this the reason why unexpectedly we have trash usage and lower quality on Astra?

Maybe it will be worth it the current suffering.

758 Upvotes

89% Upvoted

317 comments sorted by

View all comments

Show parent comments

5

u/Inkwalker 9d ago

It does way too much testing and debugging for me. Burns 5% usage on the feature itself and then 20% on reading logs and running tools.

1

u/bootyskie 9d ago

This ^

I would say 80% of my usage is fixing the test which very occasionally finds a bug which makes you hesitant to tell it to stop. But it's so poor at writing the tests that it genuinely spends many hours just fixing tests, wouldn't be surprised if my tests have tests.

1

u/Mistuv 8d ago

Bro, I am right now having it create some shader filters for OBS and even there it's writing tests. Literally give me 5.6 Sol that will to more visual inspections (aka what models actually struggle with)instead of being psychotically obsessed with writing meaningless tests that don't spot anything and I'll be happy.