Tegmark signs statement calling Anthropic the AI company doing the most harm
dansitu · x · 2026-11-19
Ahead of Anthropic's IPO, Max Tegmark signed a statement arguing Anthropic is in many ways the AI company doing the most harm: publicly warning that recursive self-improvement (RSI) could cause extinction within a decade, while privately racing ahead on RSI and touting it to investors as a "competitive advantage".
The retweeting author paraphrases Anthropic's supposed logic: RSI carries a 10%+ extinction risk and 50%+ chance of solving suffering, so the only solution is for Anthropic (Effective Altruists) to build aligned RSI first, capture market share, then use the resulting wealth to lobby for regulating non-EA AI development — predicting Anthropic will keep helping build weapons.
More from AGI Musings
- Stripe's Machine Purchase Protocol already processes tens of thousands of transactions per day — jeff_weinstein · 2026-11-19
- Gallup survey of 16,000 young people across 16 countries finds 33% have an AI companion — Grady_Booch · 2026-11-19
- Chicago Study: More Reasoning Effort Makes LLM Shopping Agents Confident, Not Correct — Uchicago · 2026-11-19
- Amodei: 50% of entry-level white-collar jobs disrupted in 1-5 years, advice is learn to use AI — alvelda · 2026-11-19
- CVPR author: using LLMs for paper storytelling polish costs more than writing by hand — AntonObukhov1 · 2026-11-19
- Staged Self-Improvement over recursive AI self-improvement proposed as the safer path — geoffreyirving · 2026-11-19