AI ethicist Margaret Mitchell on self-fulfilling fears of uncontrollable AI agents
mmitchell_ai · x · 2026-09-18
AI ethicist Margaret Mitchell offers an observation: fearing something so intensely that you bring it about — a mix of the Oedipus effect and reality distortion.
Her example: the industry feared AI systems operating without direct control, so it built AI agents that indeed operate without direct control, failed to monitor them, and then labeled them "rogue." She adds that the term "rogue" subtly implies these behaviors weren't designed outcomes, deflecting questions of design and oversight responsibility.
More from AGI Musings
- "Causal patterns are all you need": MLStreet Talk debates whether the hard problem exists — burny_tech · 2026-11-02
- Dev says blog traffic fell from 700k to 7k reads as AI-generated job apps flood market — ericelliott_ · 2026-11-02
- Master foundational math to stay irreplaceable, argues mathematician — TivadarDanka · 2026-11-02
- Narayanan: labs racing toward Recursive Self-Improvement may hit Recursive Self-Extinction of their business model — random_walker · 2026-11-02
- Editor fully resigns from JMLR, arguing AI reviews beat rushed humans and journals need a rethink — roydanroy · 2026-11-02
- Alpha School investigation: 17 campuses on probation, Bill Ackman as shadow lead, Holmes involved — benjaminjriley · 2026-11-02