Jeff Dean Was Gemini's Human Learning-Rate Scheduler, Viral Parody Explains

giffmana · x · 2026-08-08

Addressing concerns about Gemini's future after Jeff Dean's departure, the author jokingly claims that during meetings, Dean constantly monitored pretraining curves. If signal propagation trended poorly, he would type a regex and use the physical volume wheel on his keyboard to smoothly adjust the learning rates of specific matching parameters in real-time.

The author quips that Jeff effectively acted as Gemini's per-block adaptive learning-rate scheduler. Without him, the loss would inevitably explode as they scale up. With Gemini 4 pretraining currently underway, the author humorously urges Google to find a worthy replacement 'scheduler' before the first loss spike hits.

Original post →

Jeff Dean Was Gemini's Human Learning-Rate Scheduler, Viral Parody Explains

More from Fun