Safety researcher: cheap extinction-risk rhetoric is ruining public risk imagination
On September 11, AI safety practitioner DrAtoosa published a reflection on the field's failed public communication, arguing that cheapened 'AI extinction risk' rhetoric is destroying the public's risk imagination.
Confirmed
- The post traces the industry's paradox: OpenAI was founded because Sam Altman and others believed Google could not be trusted with AGI; Anthropic later spun off as the 'responsible safety' camp, then itself shifted to a 'we're building the most powerful AI' posture, accompanied by discussions of AI consciousness and welfare. The two companies created to slow Google now race each other.
- DrAtoosa notes that her friends in non-AI fields such as climate advocacy and independent film, bombarded by headlines like 'AI researchers say humanity will go extinct,' have grown weary of and hostile toward AI risk topics, tending to equate all AI risks with extinction risk.
- She criticizes the AI safety community for confusing risk narratives, substituting cheap scaremongering for effective communication.
Why it matters
- The piece reflects an internal critique of the field's communication strategy: fear-based narratives have not produced rational regulation or discussion, but instead desensitized the public and crowded out attention to concrete, present-day risks.
- It also exposes the divergence between major labs' founding intentions and current behavior—checkmakers becoming racers—providing context for today's governance dilemmas.
2026-09-11 ~ 2026-09-11 · 5 related posts
Primary sources
- Researcher rips OpenAI and Anthropic: founded to slow Google, now racing each other and scaring the public — Dr_Atoosa · 2026-09-11
- [source] AI safety insider: cheap extinction-risk talk is destroying the public's imagination of AI — Dr_Atoosa · 2026-09-11
- AI safety voices blur real risk with extinction talk, warns researcher: wrong fear is the worst fear — Dr_Atoosa · 2026-09-11
- AI Safety Practitioner: Cheap Extinction Talk Has Turned the Public Anti-AI — Dr_Atoosa · 2026-09-11
1 near-duplicate retellings: Dr_Atoosa