OpenAI Researcher on the Future of Transformers
kimmonismus · x · 2026-07-08
Jerry Tworek, who worked at OpenAI for nearly seven years on GPT-4, ChatGPT, Codex, and reasoning models, states that before exploring alternatives to the Transformer, we must first acknowledge that it is the architecture that brought AI to where it is today.
More from AGI Musings
- AI accusations shake literary prizes from Caine to Goncourt: who decides what's human? — TuhinChakr · 2026-10-26
- Tech discovers wargaming: applying to be Anthropic's tabletop exercise lead — round · 2026-10-26
- RSI is the culmination of the industrial revolution: a factory building a faster factory — tobias_rees · 2026-10-26
- NYT roundtable asks five experts what the rules for AI companies should actually be — ShakeelHashim · 2026-10-26
- Anti-AI content is algorithm gold and very profitable, quips commentator — annetgriffin · 2026-10-26
- Silicon Valley breakdown: five Stanford-area giants worth ~$18T — FinanceYF5 · 2026-10-26