Noah Smith's AI Doom Scenario Sparks Pushback: The Real Hole Is the Biolabs
kristoph · x · 2026-09-10
- Noah Smith (Noahpinion) sketches a 2029 doom scenario: a 16-year-old uses a jailbroken LLM to design 100 highly contagious, long-incubation, lethal viruses and have biolabs manufacture and ship them.
- Kristoph counters that otherwise reasonable people lose their minds over AI: in this fictional universe, the abundant cheap biolabs willing to ship deadly viruses to a teen are the real vulnerability, not the unaligned AI.
- The thread crystallizes the debate over AI risk narratives and where responsibility actually lies.
More from AGI Musings
- Greg Egan's 1995 AI classic 'Learning To Be Me' resurfaces as free full-text — ZeroStateReflex · 2026-09-10
- AI won't kill everyone: blogger rounds up essays arguing doom debate targets wrong threats — binarybits · 2026-09-10
- tszzl mocks Tegmark IV doomsayers: 'Platonic entities are welcome in my backyard' — tszzl · 2026-09-10
- Programmed love still feels real: an analogy in the AI companionship debate — MajmudarAdam · 2026-09-10
- AI-run interviews reveal a split: childfree cite freedom, would-be parents cite cost — soumitrashukla9 · 2026-09-10
- Cambridge prof David Krueger puts AI catastrophe risk above 50%, says everyone is understating it — KatjaGrace · 2026-09-10