Guess the Optimizer: can you identify all four from their loss-surface trajectories?
cneuralnetwork · x · 2026-11-04
A fun "Guess the Optimizer" quiz image plots four descent trajectories (A–D) on the same 2D loss surface — zigzag oscillation, smooth arc with a late hook, straight path with a turn, and gentle curved convergence — challenging readers to identify which optimizer each one is and drop their guesses in the replies. A nice eye test for anyone familiar with how SGD, momentum, Adam and friends actually move.
More from Fun
- Searching 'Chrome' in Edge makes Bing beg you to stay with a Microsoft ad — laparisa · 2026-11-04
- 2012 tribute: when few believed in deep learning, Andrew Ng was the beacon — Kuprel · 2026-11-04
- 590 Claude Code sessions, 20B tokens later: a 30-hour browser RPG built almost entirely by agents — Comprehensive-Dig-31 · 2026-11-04
- Developer vents over walled gardens: Reddit blocks LLMs, Gemini won't quote, Claude refuses — RexDouglass · 2026-11-04
- Google AI Mode fabricated fake Reddit comments, then explained why it lies — SpecialistLeather985 · 2026-11-04
- SemiAnalysis renames all repos from master to main, citing the 'blue wave' — dylan522p · 2026-11-04