Why it matters
Summarization shapes long conversations. Understanding shapes design.
Advertisement
The architecture
Threshold: N turns or M tokens.
LLM summarizes oldest chunk.
Replace with summary.
Advertisement
How it works end to end
Summarize per-N-turns.
Cascade: summary of summaries for very long.
Retain recent verbatim.