OpenAI Researcher on the Future of Transformers
kimmonismus · x · 2026-07-08
Jerry Tworek, who worked at OpenAI for nearly seven years on GPT-4, ChatGPT, Codex, and reasoning models, states that before exploring alternatives to the Transformer, we must first acknowledge that it is the architecture that brought AI to where it is today.
More from AGI Musings
- For many users, the real ChatGPT question is trust, not token limits — petergyang · 2026-07-27
- ARC AGI 3 should have stayed private, with no examples or public dataset — flowersslop · 2026-07-27
- AI makes knowledge cheaper, but judgment remains the scarce skill — _jaydeepkarale · 2026-07-27
- A reply to François Chollet argues intelligence is only part of the advantage — binarybits · 2026-07-27
- A Chollet quote reignites the debate over whether intelligence has diminishing returns — binarybits · 2026-07-27
- Noahpinion quotes Chollet: intelligence may hit a hard ceiling — binarybits · 2026-07-27