Tier 0 index with details on demand
The idea
The cached prefix holds an index of about 500 tokens: rules, memory notes and the profile, one line each, pinned at the first turn. Guidance files are quoted rules first within a budget, and whole items load only on demand.
- The problem
- Whole briefings and notes filled about half of each turn's context.
- Why it matters
- In a test, the always-on memory fell from 7,545 to 367 tokens, and full detail is one read away.
- Where it stands
- In production as of
A step-by-step replay of this idea is not published yet. The library adds one when a recorded run shows it.