Ex-OpenAI exec: Transformer architecture is the new learning bottleneck
_arohan_ · x · 2026-08-20
Jerry Tworek, Co-Founder of Core Automation and former VP at OpenAI, discusses why scaling RL hasn't delivered AGI. Despite benchmark improvements, real work remains undone. He diagnoses the Transformer architecture itself as the bottleneck, noting that models stop learning once deployed. The interview covers model capability limits and future directions.
More from AGI Musings
- Podcast: AI Progress, Accelerating Science, and Digital Minds — sethlazar · 2026-08-21
- Paper: AI Scientists Should Be Studied as Human-Agent Systems — rohanpaul_ai · 2026-08-21
- Omar Sanseviero: Human verification and domain expertise are the real moat in agentic workflows — omarsar0 · 2026-08-21
- AI's Most Dangerous Gift: The Illusion of Understanding — DrKavner · 2026-08-21
- After automation, human value will shift from the brain to the heart — every · 2026-08-21
- OpenAI Foundation grants SecureBio $17.2M to cut pathogen early warning from 14 days to 3 — Miles_Brundage · 2026-08-20