Context trimming saves 60% tokens but drops task success to 77%; protocol-aware method hits 96%
dair_ai · x · 2026-09-16
dair-ai highlights a paper on context trimming for agents. Prior work mostly measures tokens removed; this study also measures whether the task still succeeds.
It compares five trimming strategies on multi-step tool workflows. Recency, relevance and summarization approaches saved 60% of tokens but task success fell to 66.6%–77.3%. Protocol-aware trimming keeps identifiers, constraints, tool schemas and unresolved commitments intact while compressing the rest; with adaptive budget guardrails it reached 96.0% task success and 1.0% cascading failure while still saving 56.0% of tokens.
Budget size matters a lot: keeping ≤25% of context raised failure odds 10.92x versus keeping ≥50%, and complex workflows needed more retained context.
More from coding & agent
- What benchmarks are worth running locally? Reddit thread on DIY inference evals — JustTooKrul · 2026-09-17
- Billion-param classifiers distilled from frontier models are an order of magnitude cheaper — FrankFelixAI · 2026-09-17
- Workers Delos Raises €10M for 'AI Employees' With Their Own Email and Phone — JafarNajafov · 2026-09-17
- Why Can I Easily Find Code Optimizations That Frontier LLMs Overlook? — oyacaro · 2026-09-17
- Agentic search burns 30-50% of agent tokens: RL-trained model is 20x faster and 100x cheaper — AI Engineer · 2026-09-17
- Unity Ships Official First-Party Plugin for OpenAI Codex, Maintained by Unity Engineers — pvncher · 2026-09-17