Hinton Says Dropout Was Inspired by Banks Rotating Tellers

Hinton revealed that dropout was inspired by banks frequently rotating tellers to prevent collusion; randomly disabling about half the neurons each training step applies the same idea, helping AlexNet win ImageNet.

2026-10-25 ~ 2026-10-26 · 2 related posts