New optimizers now beat Shampoo at larger batch sizes, researcher says
_arohan_ · x · 2026-10-11
Researcher arohan claims modern optimizers can now beat Shampoo even at larger batch sizes, adding wryly that everyone benefits from better optimizers beyond where they were invented.
Related event: Google researcher says optimizers now beat Shampoo at large batch sizes(2 posts)→
More from Research
- Bittensor subnet Metanova uses competition-driven AI drug discovery with robot labs — const_reborn · 2026-10-11
- Lean4 proofs are not a silver bullet: consistency gaps, soundness bugs, and flawed benchmarks — elie · 2026-10-11
- Training inside the harness lifts Qwen3-14B from 22.2% to 54.8% on Spider 2.0-SQLite — omarsar0 · 2026-10-11
- REMAG brings GPU-first SIESTA to magnetic materials with up to 111x speedups — CatAstro_Piyush · 2026-10-11
- Yoav Goldberg blasts COLM mood: RL loss tweaks aren't 'science again' — yoavgo · 2026-10-11
- Stanford paper: fix looping agents via harness edits, bad plans need weight training — rohanpaul_ai · 2026-10-11