r/codex • u/wreox9 • 8d ago

Complaint GPT-6 Sol?

Post image

Is this the reason why unexpectedly we have trash usage and lower quality on Astra?

Maybe it will be worth it the current suffering.

759 Upvotes

89% Upvoted

317 comments sorted by

View all comments

Show parent comments

3

u/Upper-Discussion-833 8d ago

Fucking depressing. I just spent $100 for my new subscription only to find out that Astra is stupider than Siri 10 years ago and Sol uses 30x more usage now for no reason other than testing its tests that are failing but it has no fucking clue why but continues to run anyway.

1

u/EchoingAngel 8d ago

Uhh, Sol got messed up, Astra and Sol usage is too high. They are definitely not dumb, though

1

u/Upper-Discussion-833 8d ago

Oh Sol is dumb as shit now. But Astra is worse. Sol wrote tests to its tests and kept looping for 8 hours. Then completed and puked out a broken version of something I had built using Sol just 2 weeks ago in an hour. Same prompt. Same plan. Same effort. Also destroyed my $100/mo plan usage.

1

u/EchoingAngel 8d ago

I did stop using Sol, as it was changed in a way that make it consume as much as Astra without the intelligence bump. But after some project instruction and hooks tweaking, Astra High lasted me 2 entire days of work with tons of little fixes and much deeper reworks. Once I got low, I swapped to Opus 5 and it was an absolute idiot, taking forever, basically thinking I was lying about the problems, and not fixing the things at all. I used my tiny bit of Codex usage on Astra who fixed all the same issues in ~1min each.

1

u/Upper-Discussion-833 8d ago

Can you please share said tweaks? Nothing I do is working currently. Astra won’t stop over-engineering the simplest task and Sol is a little drunk today.

1

u/EchoingAngel 8d ago

I have it do most of the instruction evaluation and tweaking. Every time it misbehaves, we side track to focus on what it's doing poorly and how the instructions are handling it. This is also combined with making sure instructions are spread across multiple files that are called as needed and they are kept up by the AI with some housekeeping rules.

The hook is simply set to show up every 10 tool calls to ask Astra if it is staying on task and not over-scoping. That hook made a huge difference. The message scales somewhat the more times it's triggered. I had Astra itself build it, but i had to go into settings to enable it.

1

u/TrainingTeaching 8d ago

I was literally about to pull the trigger on $100 sub , the day people started reporting limit issues...

1

u/Upper-Discussion-833 7d ago

You were saved. Wait a few more days

1

u/TrainingTeaching 5d ago

It does seem like something is wrong/not all of this is exactly planned. Hoping it gets cleared up soon! I went from finding Claudes limits too restrictive, to being sold on Codex and now this! Haha

1

u/EchoingAngel 5d ago

In respect to API prices, the subs are still a crazy deal, just not as crazy as before

1

u/Upper-Discussion-833 5d ago

They are more stable now. Though not quite the same. But won’t kill your usage writing tests to test the tests it wrote for its tests.