Model failure handling and outage recovery
The idea
An unusable answer moves one tier up in the same call. Quota or auth failures put an arm on cooldown. A timeout retries at lower effort. A transient outage parks the item on a backoff timer and resumes the same run.
- The problem
- Bad answers were accepted, providers were retried while exhausted, and a person had to press Continue after each outage.
- Why it matters
- Work reaches a usable answer and resumes by itself, and only spent retries go up the ladder.
- Where it stands
- In production as of
A step-by-step replay of this idea is not published yet. The library adds one when a recorded run shows it.