NeurIPS 2026 Workshop Focus: Can Anything Beat Adam? Frontier Optimizers
aaron_defazio · x · 2026-08-27
The 18th International Workshop on Optimization for Machine Learning (OPT 2026) will be held in Sydney during NeurIPS 2026. The workshop particularly encourages submissions focusing on the theme "Can Anything Beat Adam? Frontier Optimizers." While Adam has dominated the past decade, new non-diagonal and second-order methods like Muon, K-FAC, and Shampoo have shown promising empirical gains at scale. The workshop aims to explore conditions under which these methods outperform Adam, their theoretical explanations, and the limits of sophisticated optimizers. The submission deadline is September 4 (AOE).
More from Research
- Implant Mimics Exercise to Fight Aging and Boost Strength in Mice — Dr_Singularity · 2026-08-27
- Study Claims Fully Autonomous Agents Outperform Scaffolding in Math Discovery — rohanpaul_ai · 2026-08-27
- BixBench3: OpenAI Leads with 48% Success Rate in AI Paper Reproduction Benchmark — anshulkundaje · 2026-08-27
- Debate: AI Still Can't Build Original Games, Only Riffs on Existing Ones — _amirabs · 2026-08-27
- 5 Fine-tuning Techniques Explained: LoRA, VeRA, and More — techNmak · 2026-08-27
- Modern LMs train on 100x more text than parameter capacity, debunking memorization myths — stanfordnlp · 2026-08-27