Former OpenAI staffer recalls 2019: GPT-2 made scaling's promise obvious
soniajoseph_ · x · 2026-10-03
Researcher Sonia Joseph congratulates Chelsea Voss and shares her recollection of joining OpenAI in 2019, when the world only knew GPT-2: a transformer producing surprisingly coherent but factually shaky, dreamlike text. Having tinkered with Markov chains and Karpathy's 2015 char-rnn in college, Voss saw immediately that scaling GPT-2 up would be revolutionary.
Related event: OpenAI Veteran Christine Voss Departs After Seven Years(4 posts)→
More from Companies & People
- Any new idea gets copied in days: Jev spawned a dozen rivals in one week — bindureddy · 2026-10-03
- Bindu Reddy: OpenAI and Anthropic are dangerous for refusing to open their frontier models — bindureddy · 2026-10-03
- Frontier lab employees flooding SF's Facebook Marketplace with furniture priced $100 under MSRP — owl_posting · 2026-10-03
- Scale AI's Alexandr Wang personally did Twitter sales 9 years before a $1B payday — kevinnbass · 2026-10-03
- Alignment researcher Zhuohao Zhang joins Anthropic as Research Fellow — xuandongzhao · 2026-10-03
- Speedrun partners with OpenAI for founder night at new SF HQ during Tech Week — andrewchen · 2026-10-03