Hot take: safety rhetoric blurred cheap AI risk with extinction risk, fueling anti-AI sentiment
Dr_Atoosa · x · 2026-09-11
A sharp industry hot take tracing how the two labs drifted: OpenAI was founded because Sam and co thought Google couldn't be trusted with AGI; Anthropic split off as the "responsible" safety-focused alternative — which then also became "we're building the best AI," with claims of moral superiority and debates over functional consciousness and AI welfare. The two companies founded to slow Google down are now racing each other.
The deeper critique: after years of policing language, safety advocates still conflate cheap AI risk with extinction risk — "real risk" has become everyday shorthand for existential risk. The result: the author's non-AI friends (climate work, indie film) read "AI researchers say AI will make humanity extinct" headlines, lose their imagination of AI helping their goals, and turn anti-AI. Wrong fear is the worst type of fear; correcting the public imagination will be hard but necessary.
Related event: Researcher Slams AI Risk Rhetoric, Traces OpenAI-Anthropic Rivalry(4 posts)→
More from AGI Musings
- After 9 Years, Bots Finally Show Up on a Blogger's Bounty Page with AI Text — gleech · 2026-09-11
- Mozilla CTO calls for major pause on generative AI in schools, warns of losing a generation — Dan_Jeffries1 · 2026-09-11
- AI safety insider: cheap extinction-risk talk is destroying the public's imagination of AI — Dr_Atoosa · 2026-09-11
- Hypothesis: ASI Has a Mathematical Incentive to Preserve Human Diversity — No_Cause_2731 · 2026-09-11
- New essay argues scaling laws originate in data structure, not architectures — gleech · 2026-09-11
- Seeking Optimism: Reddit Debates Whether Superintelligence Means Extinction — joshlove182 · 2026-09-11