Xiaomi's MoE RL stability paper: router-aware GRPO tweaks explained
tokenbender breaks down Xiaomi's arXiv paper on stable MoE RL: rather than replacing GRPO, the team adds targeted fixes such as router-aware importance-sampling rescaling and prompt-mean loss for stability and scale.
2026-09-22 ~ 2026-09-22 · 2 related posts
- Episode 1: Xiaomi MiMo's 1M-Context RL Training Details Spark Debate(2026-09-22, 13 posts)
- Episode 2: Xiaomi's MoE RL stability paper: router-aware GRPO tweaks explained(2026-09-22, 2 posts)
- Sticking with GRPO: The Four Targeted Mods Behind Xiaomi's Stable MoE RL — tokenbender · 2026-09-22
- New arXiv Paper: Router-Aware Importance Sampling Stabilizes MoE RL Training — tokenbender · 2026-09-22