Muon massively beats Adam on tiny superhuman agents across games, drones, driving
jsuarez · x · 2026-08-29
Researcher jsuarez clarifies their work is not on LLMs: they train tiny superhuman agents across games, drones, driving, and commerce sims. Under a full hyperparameter sweep for both optimizers, Muon is a massive improvement over Adam on these tasks. The thread context is a hypothesis about mode-covering in cross-entropy pretraining vs RL exploration.
Related event: Muon Optimizer Beats Adam on Small Superhuman Agents(2 posts)→
More from Research
- NVIDIA's TacitVLA: robots reason without reading their own thoughts, 3.4x lower latency — arankomatsuzaki · 2026-10-16
- Cohere Labs world model course session 4: DreamerV1-V4 architectures in one go — Cohere_Labs · 2026-10-16
- GPT-6.1 Sol audit finds 6% of arXiv papers had false main theorems, down to 1.5% recently — nitarshan · 2026-10-16
- One tiny word changes the conversation: how LLMs pick up on 'just' — StellaLisy · 2026-10-16
- SEAR: first large-scale controlled study of self-evolving robot agents, 7 LLMs, 330 tasks — xiye_nlp · 2026-10-16
- After Claude-assisted elliptic curve records fell, EC Rank challenge opens 156 record slots — Jsevillamol · 2026-10-16