After a fix, MuonM edges out Muon while MuonS performs about the same

YouJiacheng · x · 2026-11-19

YouJiacheng points to corrected experiment results on Muon optimizer variants: after the fix, MuonM performed slightly better than Muon, while MuonS was almost identical to the original. A useful empirical update for optimizer research and pretraining reproduction.

Original post →

More from Research

Research channel →