System One decision cascade
The idea
Bounded choices (route, next action, failure class, done, risk, intent) are typed questions. A rule answers first, then a typed arm, then a small LLM, each with a confidence.
- The problem
- Asking the generative model every small decision costs a full turn each time.
- Why it matters
- Small decisions are fast and cheap, and each answer is only a signal that code enforces.
- Where it stands
- In production as of
A step-by-step replay of this idea is not published yet. The library adds one when a recorded run shows it.