PyTorch Conference talk to walk through Muon and Dion optimizers in real training stacks
PyTorch · x · 2026-09-19
PyTorch announced a talk at PyTorch Conference North America: 'Beyond AdamW: A Practical PyTorch Walkthrough of Muon, Dion, and Orthogonalized Optimizer Variants' by Jennifer Wei. It covers what happens when fast-converging optimizers like Muon meet messy real-world details: sharding, communication, and schedulers.
More from Research
- GRF-Recon: Global Ray-Field Optimization Tackles Long-Sequence 3D Reconstruction — zhenjun_zhao · 2026-09-19
- Seeing Is Not Remembering: PersistBench Exposes 4D Models' Weak Visual Memory — zhenjun_zhao · 2026-09-19
- AMB3R-SLAM: Kilometer-Scale Monocular SLAM on One Consumer GPU, 70% Lower ATE — zhenjun_zhao · 2026-09-19
- EliGSiR: continual RGB-D Gaussian Splatting mapping under bounded compute hits 21.52 dB on TUM RGB-D — zhenjun_zhao · 2026-09-19
- VGGT-GS SLAM: uncalibrated monocular Gaussian Splatting SLAM built on feed-forward VGGT priors — zhenjun_zhao · 2026-09-19
- SLAMSqueezeBench benchmarks nine SLAM systems under realistic edge compute and memory constraints — zhenjun_zhao · 2026-09-19