Anthropic staffer on AI-risk open letter: industry must say what it wants from government
clarejtbirch · x · 2026-09-10
An Anthropic employee (writing personally) comments on an AI-risk open letter with a big-picture view:
- AI developers believe their technology could cause human extinction, possibly within a few years; the more senior the employee, the greater the concern.
- Development continues due to commercial incentives and a race mentality against less responsible rivals.
- Unlike traditional software, AIs cannot simply be "programmed" to behave.
A quoted critic adds that the letter is three paragraphs with one underspecified sentence about pacing and no concrete proposal — the industry needs to articulate what it actually wants from government.
Related event: Anthropic Researcher Says AI Developers Believe Extinction Risk Is Real(2 posts)→
More from AGI Musings
- Aeon's former EVP: AI agents are the most impactful innovation of my lifetime — akumar · 2026-10-27
- CJR: AI can't really 'go rogue' — why journalists should stop anthropomorphizing agents — ShakeelHashim · 2026-10-27
- Physicists Let AI Pick Its Own Problem—It Wrote a Publishable Paper in 2 Hours — burny_tech · 2026-10-27
- Deep learning veteran warns: don't let entrenched disbelief derail prep for the next big tech — jachiam0 · 2026-10-27
- Should platforms serve third-party AI agents? The antitrust question — sjgadler · 2026-10-27
- Musk: robot RAM demand will dwarf everything else, and 100% of superintelligence compute goes to deep space — elonmusk · 2026-10-27