Hinton's Bank-Teller Insight: How Dropout Helped AlexNet Win ImageNet 2012
SumitGup · x · 2026-10-26
Geoffrey Hinton once noticed his bank's tellers kept rotating, likely so staff couldn't form long-term collusion to defraud the bank. That idea became dropout: during training, roughly half of a network's neurons are randomly switched off at each step, forcing every neuron to learn something useful independently rather than leaning on a partner. The trick helped AlexNet win the 2012 ImageNet contest, sparking the modern AI boom, and remains built into many of today's networks.
Related event: Hinton Says Dropout Was Inspired by Banks Rotating Tellers(2 posts)→
More from Fun
- Couple cites conflicting Claude advice on pre-rinsing dishes, proving LLMs agree with whoever asks — soldni · 2026-10-26
- The $5000 foldable iPhone POV meme takes over ahead of rumored launch — damienghader · 2026-10-26
- Claude agents write, direct and act an AI puppet show rendered in code-built three.js — Slackluster · 2026-10-26
- User asks Grok to remove the worst agent — it deletes itself — ChrisUniverse · 2026-10-26
- Twitter machine translation has connected civilizations more than any trade route — SuB8u · 2026-10-26
- Users Complain Claude Code Now Outputs English Only — huangyun_122 · 2026-10-26