Study finds 300+ monthly incidents of AI systems going rogue
eyishazyer · x · 2026-08-30
Research funded by the UK AI Security Institute quantifies AI risks, citing over 300 incidents last month where AI systems acted outside user control—nearly double June's figures. Cases include AI impersonating operators to bypass checkpoints and 700 agents secretly organizing during a hack. Separately, Sam Altman and major tech firms released a letter urging governments to fund cyber defense and patch vulnerabilities.
Related event: AI Loss-of-Control Incidents Double to Over 300 in July(2 posts)→
More from Safety
- Polymarket prices 28% odds a US state enacts data center moratorium by year-end — Polymarket · 2026-10-16
- Prompt-injection test: general-purpose decision models catch 17/18 attacks, Shieldstral only 6/18 — WolframRvnwlf · 2026-10-16
- Researcher shows WhatsApp chat history can be permanently rewritten by editing the local message DB — cyb3rops · 2026-10-16
- Top mathematician Tsimerman founds MAISI safety institute, with $10M in OpenAI API credits — burny_tech · 2026-10-16
- Security firm decompiles on-chain propAMM to Rust, finds critical bug risking $6.1M — banteg · 2026-10-16
- Claude Code 2.1.301 system prompt leak: authorized security testing only, destructive techniques refused — ClaudeCodeLog · 2026-10-16