gemini-cli issue proposes model-judged context pruning for junk tool outputs

nicezic · ghdev · 2026-11-05

A new gemini-cli issue proposes letting the model swap a junk tool output for a one-line, model-judged summary before the turn ends, so later turns stop re-sending megabytes of irrelevant content. Key points: prevention can't work since you open files precisely because you don't know their contents — this gives the model the ability to "look away"; prefix-based implicit caching keeps costs low since only the tail is re-cached; and removing junk grows the effective window nonlinearly (+11% at 10% junk share, +100% at 50%), delaying compaction. Includes a demo GIF and full sequence diagrams; currently awaiting triage.

Original post →

More from coding & agent

coding & agent channel →