"If your AI work risks 800 million lives, quit": debate over developer moral duty
soumitrashukla9 · x · 2026-09-12
A viral post argues that anyone working on a project with an expected loss of 800 million lives — without equivalent benefit — has a moral duty to quit and work to halt development, rather than rationalizing that it's safer if they control it.
The argument, aimed at frontier AI workers, is fueling debate over individual responsibility versus the illusion of control in AI risk.
More from AGI Musings
- Dev draws AI parallels with opium history: morphine epidemic, heroin, and 'incredible work everyone' — threepointone · 2026-09-12
- Kording: RLHF Erases the Original Source of Ideas From AI-Explained Attribution — KordingLab · 2026-09-12
- Kording Lab: RLHF strips idea attribution from AI answers because users prefer to feel it's theirs — KordingLab · 2026-09-12
- SoftBank's Masayoshi Son Predicts 100 Trillion Self-Replicating AIs That Will Surpass Humans — Puzzleheaded-King584 · 2026-09-12
- Gary Marcus amplifies take: AI development is an unregulated gain-of-function experiment — GaryMarcus · 2026-09-12
- Hot take: AI didn't close intelligence gaps, it just made lazy thinkers 100x more slop — claud_fuen · 2026-09-12