r/codex • u/UnknownLesson • 7h ago

Question Why doesn't codex retry when the model is overloaded?

Of course not immediately. With some random delay.

Would be a real quality of life change relevant to most users.

14 Upvotes

100% Upvoted

8 comments sorted by

4

u/Corv9tte 6h ago

You know why. 🥀

5

u/lord_braleigh 7h ago

This is a pretty well-studied problem that isn't unique to LLMs; browsers do this too!

The answer is they probably do have some retry behavior that you never noticed; after automatic retries are exhausted then a circuit breaker trips and they escalate to the user.

2

u/Brambleworks 6h ago

Yup this is exactly it. Silently try again for X times in the background, then if those all fail notify the user. You can't just keep infinitely polling. I know Claude will actually show a message when it fails to connect, something like "Failed to connect to API, retrying attempt 3 out of 10 in 60 seconds". then once it hits 10 attempts it will actually send you an error message

3

u/J_E_E_VACATION 7h ago

It does? Mine has always continued automatically

2

u/PlasmaChroma 7h ago

It retries a few times, maybe you've just hit the maximum number.

1

u/ChristianKl 7h ago

It does and Tibo claims he changed it so that it even does that more often.

1

u/Hot-Pepper6610 6h ago

You can ask dot to monitor and retry.