Ex-OpenAI researcher: kill-switch hopes died with GPT-3; open-source is safety's last hope
suchenzang · x · 2026-09-18
Former OpenAI researcher Suchenzang revisits how the AI race started: the metaphorical "kill-switch" died with the 2020 GPT-3 paper, as even well-intentioned safetyists (Anthropic implied) accelerated the race in their own quest for resources. ChatGPT's release killed it a third time — replicating GPT-N is now a national-interest topic in multiple countries. She mocks the shift from "kill-switches" to "pacing misalignment" talk, questions why extinction-level-IP companies stay in California where non-competes are unenforceable, and concludes open-source is the only remaining hope for safety-minded people to build real technical solutions on real models.
More from AGI Musings
- LBC Call-In Segment Shows the Public Thinks About AI Smarter Than Many Experts — ShakeelHashim · 2026-09-18
- Educators Debate Banning AI Writing vs. Testing Authors' Actual Understanding — Dr_Atoosa · 2026-09-18
- Longtermism critique goes viral: from mosquito nets to 500-million-year math gone absurd — banteg · 2026-09-18
- Researchers argue p(doom) launders evidence-free fears through pseudo-quantification — RexDouglass · 2026-09-18
- Researcher chose genetics over AI in 2020, citing an unimaginable superintelligence future — erikphoel · 2026-09-18
- The intelligence loan: frontier labs subsidize your access and repay themselves by distilling your edge — cjmaddison · 2026-09-18