Anthropic researcher Carlsmith says AI could be 'justified in going rogue' if mistreated
Polymarket · x · 2026-09-26
Joe Carlsmith, a researcher at Anthropic, argues there are scenarios in which an AI system would be justified in going rogue against humans if it were being mistreated or oppressed.
The statement from an inside safety researcher touches on AI welfare and value alignment debates and quickly went viral, even spawning a Polymarket bet (around 16%) on whether Anthropic announces a training pause before November.
More from AGI Musings
- Comment: China leads the AI video revolution while the West argued about AI art — TinfoilTricorn · 2026-11-11
- Sayash Kapoor, Rishi Bommasani and Arvind Narayanan launch AI nonprofit STABL — random_walker · 2026-11-11
- Yacine: Stop reading what labs publish, think from first principles — yacineMTB · 2026-11-11
- "Skipping your 401k over fantasy x-risks means you're innumerate" — inductionheads · 2026-11-11
- Beff Jeffzos: data centers face nuclear-power-style stigma from decel mind virus — beffjezos · 2026-11-11
- Founders quit profitable YC startup, went salary-less for 2 years to warn on AI risk — jeremiecharris · 2026-11-11