Timothy B. Lee: Transformers won't reach AGI, a new architecture is likely needed
binarybits · x · 2026-09-19
Understanding AI author Timothy B. Lee lays out why he doesn't expect a fast takeoff: Transformers can't learn new concepts at inference time and likely won't reach AGI; a new architecture would take years to scale; businesses will need years to fully exploit AGI; and robotics transformation will lag AGI by several years.
More from AGI Musings
- Andreessen: Agents Are Entering Enterprises as Chaos, Just Like PCs and Spreadsheets Did — Dan_Jeffries1 · 2026-11-04
- 1000+ mathematicians sign pledge to shun AI companies and models — Shesawthat · 2026-11-04
- Von Neumann meme: "You don't have to be responsible for the world that you're in" — akbirthko · 2026-11-04
- Joscha Bach on the dream chocolate that stopped being real — Machine Learning Street Talk · 2026-11-04
- François Chollet: modeling brain wiring as an engineering problem constrained by genome size and time — CatAstro_Piyush · 2026-11-04
- Most US Couples Now Meet in a Data Centre, Doubling Office Matches — menhguin · 2026-11-04