Former OpenAI staffer recalls joining in 2019, when GPT-2 was the cutting edge

saranormous · x · 2026-10-04

csvoss reflects on joining OpenAI in 2019, when the world only knew GPT-2: a transformer producing surprisingly coherent but factually wrong, dreamlike text. Having tinkered with Markov chains and Karpathy's 2015 char-rnn, they saw immediately that scaling GPT-2 would be revolutionary. saranormous congratulated them.

Related event: OpenAI Seven-Year Veteran csvoss Departs, Having Joined in the GPT-2 Era(7 posts)→

Original post →

More from Companies & People

Companies & People channel →