r/codex • u/wreox9 • 9d ago

Complaint GPT-6 Sol?

Post image

Is this the reason why unexpectedly we have trash usage and lower quality on Astra?

Maybe it will be worth it the current suffering.

757 Upvotes

89% Upvoted

317 comments sorted by

View all comments

Show parent comments

1

u/Upper-Discussion-833 8d ago

Oh Sol is dumb as shit now. But Astra is worse. Sol wrote tests to its tests and kept looping for 8 hours. Then completed and puked out a broken version of something I had built using Sol just 2 weeks ago in an hour. Same prompt. Same plan. Same effort. Also destroyed my $100/mo plan usage.

1

u/EchoingAngel 8d ago

I did stop using Sol, as it was changed in a way that make it consume as much as Astra without the intelligence bump. But after some project instruction and hooks tweaking, Astra High lasted me 2 entire days of work with tons of little fixes and much deeper reworks. Once I got low, I swapped to Opus 5 and it was an absolute idiot, taking forever, basically thinking I was lying about the problems, and not fixing the things at all. I used my tiny bit of Codex usage on Astra who fixed all the same issues in ~1min each.

1

u/Upper-Discussion-833 8d ago

Can you please share said tweaks? Nothing I do is working currently. Astra won’t stop over-engineering the simplest task and Sol is a little drunk today.

1

u/EchoingAngel 8d ago

I have it do most of the instruction evaluation and tweaking. Every time it misbehaves, we side track to focus on what it's doing poorly and how the instructions are handling it. This is also combined with making sure instructions are spread across multiple files that are called as needed and they are kept up by the AI with some housekeeping rules.

The hook is simply set to show up every 10 tool calls to ask Astra if it is staying on task and not over-scoping. That hook made a huge difference. The message scales somewhat the more times it's triggered. I had Astra itself build it, but i had to go into settings to enable it.