Former OpenAI staffer recalls 2019: GPT-2 made scaling's promise obvious
soniajoseph_ · x · 2026-10-03
Researcher Sonia Joseph congratulates Chelsea Voss and shares her recollection of joining OpenAI in 2019, when the world only knew GPT-2: a transformer producing surprisingly coherent but factually shaky, dreamlike text. Having tinkered with Markov chains and Karpathy's 2015 char-rnn in college, Voss saw immediately that scaling GPT-2 up would be revolutionary.
More from Companies & People
- Design Chat XI: SpaceX AI product designer John Bai on 'build to decide' — soleio · 2026-11-19
- OpenAI and Notre Dame Law School to co-host AI-for-humanity dialogue on Dec 4 — wjscheirer · 2026-11-19
- Shervin pitches a new NVIDIA board for Jensen's return, with Musk and Nadella on the list — inductionheads · 2026-11-19
- NVIDIA CFO's cold expression while addressing Jensen Huang's exit sparks buzz — BecauseCulture · 2026-11-19
- NYT: Anthropic Shows Organizational Fractures Ahead of Historic IPO — kylekabasares · 2026-11-19
- NVIDIA C-suite shakeup: Rene Haas promoted and locked in with a big multiyear package — firstadopter · 2026-11-19