OpenAI staff claims Transformer is now the bottleneck to AI progress
KyeGomezB · x · 2026-08-26
Kye Gomez cites OpenAI engineer Jerry Tworek's argument that the Transformer architecture itself has become the bottleneck to faster AI progress. Tworek contrasts this with the rapid evolution of early planes and computers, suggesting that while Transformers are successful, better architectures likely exist that deserve compute investment. Gomez criticizes the field for defaulting to throwing compute at Transformers instead of researching new architectures.
More from Companies & People
- AI Coding Risks Preventing Expertise, Creating 'Expert Novice' Trap — addyosmani · 2026-08-26
- OpenAI Reportedly Developing Custom Chips, Codenamed Jalapeno — beffjezos · 2026-08-26
- OpenAI Accused of Unauthorized Annual Plan Upgrade, Discount Lost — phoenix177 · 2026-08-26
- OpenAI Architect: 'You Can Just Build Chips' — beffjezos · 2026-08-26
- McGraw Hill CEO: Future of knowledge will be agentic — rohanpaul_ai · 2026-08-26
- Anthropic tells employees stock could go to zero, pitches $30T market to IPO investors — kyliebytes · 2026-08-26