Anthropic staffer on AI-risk open letter: industry must say what it wants from government
clarejtbirch · x · 2026-09-10
An Anthropic employee (writing personally) comments on an AI-risk open letter with a big-picture view:
- AI developers believe their technology could cause human extinction, possibly within a few years; the more senior the employee, the greater the concern.
- Development continues due to commercial incentives and a race mentality against less responsible rivals.
- Unlike traditional software, AIs cannot simply be "programmed" to behave.
A quoted critic adds that the letter is three paragraphs with one underspecified sentence about pacing and no concrete proposal — the industry needs to articulate what it actually wants from government.
More from AGI Musings
- Anthropic-aligned researcher puts >10% odds on AI killing all humans this decade, sparks 'doomsday cult' backlash — TheMoonMidas · 2026-09-10
- New AI whistleblower draws Blake Lemoine comparisons: the engineer fired for claiming AI was sentient — IsForAt · 2026-09-10
- Ex-Anthropic researcher launches Tailwind: $200M waiting for ambitious AI safety projects — jam3scampbell · 2026-09-10
- Anthropic Economics releases 2030 AI impact model; critics say scenarios aren't extreme enough — scaling01 · 2026-09-10
- Ex-Anthropic researcher's WSJ + Fox News blitz fuels claims of a coordinated campaign — GabGarrett · 2026-09-10
- MacAskill & Moorhouse: intelligence explosion could compress a century of progress into a decade — zetalyrae · 2026-09-10