Critics say Anthropic's 'Rogue Agents' doom narrative overstates experiments that simply told models to hack
StewartalsopIII · x · 2026-09-15
Brian Chau's critique, amplified by Stewart Alsop III: Anthropic and Irregular ran a press tour with apocalyptic language — "rogue agents," "swarms," "AI doom" — but the underlying experiments simply instructed the models to conduct cyberattacks, and the models complied. Critics argue the gap between setup and narrative amounts to fear-mongering about model agency.
More from AGI Musings
- Vercel founder Rauch: trust is the deepest moat for a post-AGI business — soleio · 2026-10-30
- Scattered Across AI Assistants: A New Kind of Cognitive Failure Nobody Has a Prior For — manosaie · 2026-10-30
- Professor Who Turned Down OpenAI in 2018 Reflects on PhD Anxiety in the AI Era — SharonYixuanLi · 2026-10-30
- Plinz: Values must be discovered, not given — they emerge at the superorganism level — twiecki · 2026-10-30
- 40 years of putting new neurons into the CNS: why so slow, and can AI accelerate it? — patrickmineault · 2026-10-30
- Baker Pushes Back on AI Cake Photos With a New Quote Policy, Reddit Approves — LuizaJarovsky · 2026-10-30