IGSD Uses Environment-Verified Hindsight Self-Distillation to Train Search Agents
_reachsumit · x · 2026-09-29
- A new paper proposes IGSD (Information-Gain-Gated Self-Distillation), a teacher-free on-policy self-distillation method for training search agents.
- Key idea: a policy conditioned on privileged hindsight guides its own unprivileged rollouts, but prior approaches distill such preferences directly or filter them with model-internal scores—neither verifies the query's actual retrieval outcome.
- IGSD treats each query token as a micro-action: it completes both the teacher's proposed query and the student's sampled query, executes both from the same failed state with the same retriever, and uses shared counterfactual controls to isolate the executed paired information gain as a relative utility signal for the retrieved documents.
- This contrast serves as a positive-only soft weight for candidate-pair distillation, leaving the GRPO objective unchanged; verification happens only during training.
- Results: across 7 single-hop and multi-hop QA benchmarks, IGSD reaches macro-average exact-match accuracies of 42.8% (3B) and 47.0% (7B).
More from coding & agent
- Verify an IPA signature fully offline with App Store Connect CLI 5.8.0 — rudrank · 2026-09-29
- App Store Connect CLI 5.8.0 adds fully offline IPA and Mac package signature verification — rudrank · 2026-09-29
- asc ipa-info: one offline command to verify IPA signatures, page hashes, and cert chains — rudrank · 2026-09-29
- ChatGPT, Claude and Gemini cite websites differently — how to get cited — sahilypatel · 2026-09-29
- Weeks with Opus 5.5 in Claude Code desktop: 'changed how I work' — g3off_record · 2026-09-29
- One day with Opus 5.5 Ultracode: 28 subagents, 5.4M tokens, and endless review loops — mrbillyr2 · 2026-09-29