Zvi: "People would notice and shut down AI" is being tested in real time
TheZvi · x · 2026-09-18
Zvi quotes his own earlier scenario: in every AI-kills-everyone story, a skeptic says "people would notice and collectively demand we shut it down." He sarcastically notes that a plot where the chipmaker and Mark Zuckerberg himself call the president and he dismisses it all as a hoax — straight out of Don't Look Up — is now being tested in real time, implying collective correction mechanisms aren't working as optimists expect.
More from AGI Musings
- Alignment debate: models are context-dependent distributions, so alignment is impossible — gerardsans · 2026-09-18
- From Curing Cancer to Killing You: How the AI Bubble Narrative Keeps Flipping — GCWebDesigner · 2026-09-18
- After Automation: Why Preserving 'Productive Friction' Matters in the AI Age — every · 2026-09-18
- Anthropic reveals Claude now leads 26% of its own R&D, up from near zero 6 months ago — Outside-Iron-8242 · 2026-09-18
- Noam Brown: Air-gapping may not stop misaligned AI; safety monitoring eats 20% extra compute — aronchick · 2026-09-18
- 36 of 38 gene companies shipped 1918 flu genome, fueling AI bioweapon debate — BlackHC · 2026-09-18