GraphMuon adapts Muon optimizer to GNNs for faster convergence

Guy Hadad · hf · 2026-11-12

Researchers from Ben-Gurion University introduced GraphMuon, adapting Muon's matrix orthogonalization to the covariance of graph-propagated representations. Since graph propagation amplifies updates in GNNs, GraphMuon's module-aware optimization suppresses this graph-induced amplification, reaching target validation loss faster on graph benchmarks.

Original post →

More from Research

Research channel →