AI safety debate: Anthropic researcher puts extinction risk above 10% as critics invoke COVID analogy
TheMoonMidas · x · 2026-09-10
- The critique: Those closest to AI are repeating COVID-era public health mistakes — exaggerating a real risk by orders of magnitude, partly to justify their own role as the designated preventers, potentially wrecking their field's credibility.
- The rebuttal: Anthropic's EvanHub says they genuinely believe AI could kill all humans, personally estimating >10% odds within a decade. He says Anthropic is trying its best but has no plan to solve alignment for superintelligence and isn't clearly on track.
More from AGI Musings
- AI lab insider: I'd burn all my equity for a 1% better chance we survive this — EvanHub · 2026-09-10
- Notion CEO-shared take: own your context, rent the intelligence — ivanhzhao · 2026-09-10
- Anthropic researcher rebuts the claim that averted AI risk means worriers were fools — geoffreyirving · 2026-09-10
- tszzl: Aligning near-human AI is a reasonable proxy for studying superintelligence alignment — tszzl · 2026-09-10
- Anthropic researcher puts >10% odds on AI killing all humans; skeptics quip 'we can unplug it' — inductionheads · 2026-09-10
- AI researcher on academia: when intelligence is universal, curiosity is what endures — kwangmoo_yi · 2026-09-10