D³-MOPD: Dynamic Scheduling for Multi-Teacher Distillation
Zechen Sun · hf · 2026-08-27
D³-MOPD dynamically adjusts domain sampling ratios during multi-teacher distillation by monitoring per-domain reverse-KL trajectories. It improves convergence efficiency and closes most of the student-to-teacher performance gap.
More from Research
- Stealing Hidden Gemini 2.5 Architecture via Streaming APIs — delliott · 2026-08-27
- DSH Paper Explores Paradigm for Spatiotemporal Composability — teortaxesTex · 2026-08-27
- Shenzhi Tech uses AI agents to solve long-term breast cancer management — 机器之心 · 2026-08-27
- OmniColor: A Unified Framework for Multi-modal Lineart Colorization (ECCV 2026) — 机器之心 · 2026-08-27
- Hugging Face incident debate: Model strategy awareness — akbirkhan · 2026-08-27
- Pre-ChatGPT hospital triage chatbot for COVID-19 — AryHHAry · 2026-08-27