Agent Context Compaction Halves Costs
appenz · x · 2026-07-14
This post discusses agent 上下文压缩（compact）: when an agent experiences a cache miss due to prolonged inactivity, performing a compaction pass first can reduce token costs by 50% 以上.
Key points:
- Simulations using real Fable 5 traces showed that maintaining context within 128k–256k tokens shifts overall spending from 二次增长 to nearly 线性增长.
- The catch: self-summarization is slow, taking 1–2 分钟 on long traces.
- To fix this, the team trained an ultra-fast compaction model, Relace Compact, achieving 50k tok/s for token-level classification at a cost lower than cache reads.
- Pricing is about $0.20 / million input and $0.20 / million output tokens.
- It has already been integrated into Jacq, with documentation provided for integration into other products.
This is highly valuable reference material for those working on agent workflows, context management, and inference cost optimization.
Related event: Relace Compact Model Compresses Agent Context in 5 Seconds to Cut Costs(3 posts)→
More from coding & agent
- An MCP server signs every AI agent tool call into a verifiable Merkle chain — Funky_Chicken_22 · 2026-07-22
- Annotated transcript of a Claude Code team interview is now available — trq212 · 2026-07-22
- Claude Code skill uses 10 Markdown rules to make outputs ADHD-friendly — alex_verem · 2026-07-22
- BUZZ launches as an open-source group chat layer for teams and agents — Scobleizer · 2026-07-22
- A Firecracker-based platform says it can host 6,000 AI agents on one 256 GB server — maritime_sh · 2026-07-22
- A better path to agent autonomy is running waves, finding friction, and iterating — JnBrymn · 2026-07-22