Google's AdviSD trains small LLM advisors via selective self-distillation, beating GRPO by up to 6.4 points
google · hf · 2026-10-01
Google proposed AdviSD (Advisor Self-Distillation), which trains a small advisor model to steer frozen frontier executors (Gemini, Claude) with natural-language advice.
- Key finding: corrections that plausibly look right but don't change execution can hurt learning; the paper proves this for shared-parameter advisors
- Method: outcome-based RL plus selective self-distillation from a feedback-conditioned advisor copy — the advisor scores the same executor response with and without its advice, supervising only where the score gap is large; no executor likelihoods or extra rollouts needed
- Qwen3-8B advisors outperform advisor-GRPO by 4.2-6.4 points on BFCL-v3 and 3.9-5.1 points on EnvScaler
- Advisors generalize out-of-domain and transfer across executor versions and model families
More from Research
- In business, Type 2 errors often cost more than Type 1 errors — mdancho84 · 2026-11-16
- In risk management, missing a real risk can sink the business — mdancho84 · 2026-11-16
- Cost of Type 2 error: a missed pregnancy delays prenatal care — mdancho84 · 2026-11-16
- Cost of Type 1 error: a false alarm is usually temporary and clarifiable — mdancho84 · 2026-11-16
- Thread defines Type 2 error: false negative means missing a real effect — mdancho84 · 2026-11-16
- Thread defines Type 1 error via pregnancy test: false positive explained — mdancho84 · 2026-11-16