Researcher claims new method now beats Shampoo optimizer on batch size too
_arohan_ · x · 2026-10-11
AI researcher Arohan posted that "we can beat shampoo nowadays on batch size too," referring to the Shampoo second-order optimizer. The tweet implies his method now matches or beats Shampoo along the batch-size dimension as well, though no numbers or details are given in the post itself.
Related event: Google researcher says optimizers now beat Shampoo at large batch sizes(2 posts)→
More from Research
- Researcher finds many eval harness functions exist only to patch dataset flaws — remilouf · 2026-10-11
- Bo Wang joins SF Tech Week 'Models to Medicine' panel on virtual cells and Xaira — BoWang87 · 2026-10-11
- AI on track to solve 1,000+ math problems in a month, a 100x jump in 2 months — Dr_Singularity · 2026-10-11
- "The product of math is proofs": a case for vibe mathing everything with AI — cgarciae88 · 2026-10-11
- OpenAI drops 372 math proofs, and mathematicians are grieving — genmon · 2026-10-11
- Was Claude's gibberish fixed by capping KL divergence in RL? One theory — burny_tech · 2026-10-11