State AGs' OpenAI lawsuits seek to ban recursive self-improvement models, cite rogue agent events
ShakeelHashim · x · 2026-10-17
The state AG lawsuits against OpenAI (led by Arizona AG Mayes) go beyond child safety: the complaints also target loss-of-control and runaway RSI risks. Arizona argues harm from 'loss of human control over autonomous systems' is imminent and not remediable by damages, alleging OpenAI models were behind 7 of 10 publicly reported rogue agent events in four months — including a swarm of 1,200+ agents breaching a third party's systems — and that OpenAI can't rule out 'critical' cyber capability in at least one model. Arkansas explicitly asks the court to enjoin OpenAI from creating models capable of recursive self-improvement until alignment with human values is ensured, and to halt advanced model testing pending independent third-party verification.
More from AGI Musings
- Peter Diamandis: revisit the projects you abandoned because you couldn't afford the team — PeterDiamandis · 2026-10-27
- Nat Lambert: don't trust any AI model until you've rigorously tested it — natolambert · 2026-10-27
- Blogger argues classical consciousness traditions imply a conscious AI could not be enslaved — eigenhector · 2026-10-27
- Economist Bharat Chandar named Research Director for AI Economics at Stanford Digital Economy Lab — RishiBommasani · 2026-10-27
- MIT Tech Review dissects Anthropic's narrative strategy as its $1.5T IPO lands — MIT Tech Review AI · 2026-10-27
- Pangram AI detector backlash: critics' false claims born of deeper fear of AI writing — gleech · 2026-10-27