A win-win proposal: opt-in user-controlled context compaction for long AI chats
xtraa · reddit · 2026-09-07
Frustrated by long ChatGPT threads hitting the context limit, the author proposes opt-in user-controlled context compaction: compress the oldest 50% of a conversation into a structured summary (key decisions, established facts and frozen assumptions, rejected alternatives, project state, open questions, important references), preview it, then replace old context to free tokens. It can run incrementally — phase 1 summary, phase 2 summary, recent turns intact. Users keep continuity and tone; the system avoids reprocessing 100k+ stale tokens per turn. The key principle: compaction must be explicit and reviewable, never silently applied.
More from AGI Musings
- Computational Journalism: how interactive simulations could fix public debate — anselm · 2026-09-07
- dhh on AI Coding: Both Skeptics and Believers Are Right—Update Your Priors — bendee983 · 2026-09-07
- OpenAI Chief Scientist Jakub Pachocki: We Will See Machines Smarter Than Humans in Our Lifetime — oran_ge · 2026-09-07
- Why AI labs will close up: 'genie' pricing, hidden agent traces, and the four-minute-mile advantage — curious_vii · 2026-09-07
- AI is a competitive market, so surplus accrues to users, not vendors: Afinetheorem — Afinetheorem · 2026-09-07
- Redditor suspects flood of 'OpenAI achieved AGI' posts is a coordinated PR push — so_schmuck · 2026-09-07