Google's Denny Zhou: "The best models make the best data" since 2026
denny_zhou · x · 2026-11-20
Google researcher Denny Zhou posted a widely-shared aphorism:
- Before 2026: the best data made the best models.
- Since 2026: the best models make the best data.
It points to a paradigm shift toward synthetic data and model bootstrapping—the source of data advantage moves from human labeling to the models themselves, changing the logic of the industry's competitive flywheel.
More from AGI Musings
- Emad Mostaque: 'human in the loop' breaks when AI outruns review — VraserX · 2026-11-20
- Mathematician Proposes "Timing Attacks" to Detect AI Contact Lens Cheating — AlexKontorovich · 2026-11-20
- Investor Says Anthropic's Moat Is an 'Intelligence Moat' That's Hard to Catch — shaunmmaguire · 2026-11-20
- Paper Revisits How Longshoremen Unions Faced the Containerization Shock — Afinetheorem · 2026-11-20
- Median human earns ~$3k/yr in Asia — so whose values does Anthropic actually share? — NathanpmYoung · 2026-11-20
- Israeli bank exec: AI lets fewer devs ship more products, but no layoffs wave — ziv_ravid · 2026-11-20