Ex-OpenAI engineer recalls 2019: GPT-2 made the scaling revolution obvious
seanmcdonaldxyz · x · 2026-10-03
Replying to @csvoss's departure, former OpenAI engineer Sean McDonald recalls joining in 2019 when the world only knew GPT-2 — a transformer producing surprisingly coherent but factually wrong, dreamlike text. Having tinkered with Markov chains and Karpathy's 2015 char-rnn in college, he says it was immediately obvious GPT-2, if scaled, would be a revolution. A fond farewell to his OpenAI run.
More from Companies & People
- Design Chat XI: SpaceX AI product designer John Bai on 'build to decide' — soleio · 2026-11-19
- OpenAI and Notre Dame Law School to co-host AI-for-humanity dialogue on Dec 4 — wjscheirer · 2026-11-19
- Shervin pitches a new NVIDIA board for Jensen's return, with Musk and Nadella on the list — inductionheads · 2026-11-19
- NVIDIA CFO's cold expression while addressing Jensen Huang's exit sparks buzz — BecauseCulture · 2026-11-19
- NYT: Anthropic Shows Organizational Fractures Ahead of Historic IPO — kylekabasares · 2026-11-19
- NVIDIA C-suite shakeup: Rene Haas promoted and locked in with a big multiyear package — firstadopter · 2026-11-19