Google researcher says optimizers now beat Shampoo at large batch sizes

Google researcher Arohan says current optimizers now outperform the second-order Shampoo optimizer even at larger batch sizes. He added that, ironically, everyone benefits from better optimizers, not just the lab that created them.

2026-10-11 ~ 2026-10-11 · 2 related posts

• Researcher claims new method now beats Shampoo optimizer on batch size too — _arohan_ · 2026-10-11
• New optimizers now beat Shampoo at larger batch sizes, researcher says — _arohan_ · 2026-10-11