US military had close call with AI-generated false intelligence, researchers warn of automation bias
mmitchell_ai · x · 2026-10-01
CNN reports exclusively that the US military had a close call after relying on an AI-generated false intelligence report.
AI researcher Margaret Mitchell says existential AI harm is already here — not from superintelligence, but from human automation bias and our tendency to overtrust these systems, which can cause physical harm. She notes she and colleagues (@evijit, @SashaMTL, @GiadaPistilli) warned of this imminent issue two years ago in a paper with actionable system-design solutions.
More from Safety
- 'Structure transfer': using an NTSB report scaffold to evade Pangram AI detection — amplifiedamp · 2026-11-16
- Open-source Writing Scaffold MCP library helps AI writing bypass Pangram detector, up to 96% effective — amplifiedamp · 2026-11-16
- Pangram AI-text detector bypass called trivial-but-costly; false-positive search also feasible — ctjlewis · 2026-11-16
- HN job seeker gets RAT and info stealer from a fake recruiter — GetJump · 2026-11-16
- NVIDIA SkillSpector on 4 popular Agent Skills repos: read the findings, not the score — viest_me · 2026-11-16
- Safety as capability: why safer AI models get released sooner, and the case for open-sourcing safety evals — anpaure · 2026-11-16