Denny Zhou: model depth is what matters for reasoning, loops are just cheap depth

denny_zhou · x · 2026-09-03

Google researcher Denny Zhou argues that what fundamentally matters for reasoning is model depth, and that loops are merely a cheap way to increase effective depth. The take comes from his lecture at Stanford CS last year.

Related event: Looped Transformer Debate: Just Deeper Networks or Real Recurrence?(8 posts)→

Original post →

More from AGI Musings

AGI Musings channel →