Muon shown to be a special case of Shampoo optimizer
_arohan_ · x · 2026-11-13
Optimizer researcher Inderjit congratulates John Langford and the CoreAI team, confirming that Muon is a special case of Shampoo. Arohan amplified the finding, noting Dimuon and Distributed Shampoo "game recognizes game" — theoretically connecting the trendy Muon optimizer used in LLM training to the classical second-order Shampoo method.
More from Research
- Speculative Self-Distillation cuts training tokens 38–69% with no accuracy loss — Azaliamirh · 2026-11-13
- tszzl: local minima are rare in high-dimensional spaces — the greatest whitepill — JensHonack · 2026-11-13
- Chronicle Bio announces first clinical trial with Prolong, using AI to match patients for ME/CFS drug — thekaransinghal · 2026-11-13
- Salesforce's A²-Bench: 500 scenarios expose 20 failure modes in multi-agent teamwork — mohitban47 · 2026-11-13
- Matrix optimizers likely within 5-10% CE of each other, researcher argues — _arohan_ · 2026-11-13
- Princeton/Stanford study: optimizer rankings reverse as batch size changes — _arohan_ · 2026-11-13