Safety-minded staff leaving AI labs: the optimal quit rate is far from 0% and far from 100%
jeremiecharris · x · 2026-09-11
The author weighs whether safety-concerned staff should quit AI labs or stay:
- Case for quitting: raises awareness and redirects effort away from accelerating AI.
- Case for staying: if all safety-pilled staff leave, remaining staff are likelier to take crazy risks, labs make more dangerous moves, and outsiders lose inside warnings about warning shots.
- Leaving only makes sense if the race to ASI could be halted imminently — which would require China agreeing to a coordinated slowdown plus serious domestic regulation.
- Conclusion: the optimal share of safety researchers quitting in protest is far from 0% and far from 100%.
More from AGI Musings
- Gary Marcus: if you fear AI, stop using it and hit companies where it hurts—the IPO — GaryMarcus · 2026-09-11
- Rob LeClerc proposes a site where AI lab staff bet equity on their own p(doom) — robleclerc · 2026-09-11
- Ex-OpenAI/Anthropic pretraining researcher resigns, citing reckless ASI race — oh_that_hat · 2026-09-11
- Eric Topol and JAMA AI editor discuss what it takes for AI to shift medicine to prediction and prevention — EricTopol · 2026-09-11
- Gary Marcus: If you really worry about AI, stop using it and send companies a message — GaryMarcus · 2026-09-11
- The barbell strategy for thriving in a post-AGI world: double down on AI and on being human — brandon_galang · 2026-09-11