AI safety researcher: AI exceptionalism has broken product safety standards
sarahbmyers · x · 2026-09-13
AI safety researcher Sarah Myers argues that "AI exceptionalism" has led society to abandon its normal standards for product safety: any system with too high an error rate, too much risk and insufficient substantiated benefit would normally be pulled, but AI gets a pass. She says this directly causes catastrophic, often irreversible harms and amounts to widespread corporate negligence — citing misdiagnosed patients, waves of AI-generated phishing attacks, and civilians wrongly targeted by AI-enabled weapons.
More from AGI Musings
- Alignment Is an Algorithm Problem: Why RL Can't Optimize "Don't Harm Humans" — MillionInt · 2026-09-14
- Chilson recommends Hazlett's 'The Political Spectrum' on Bell monopoly and innovation — neil_chilson · 2026-09-14
- Raphael Millière: under uncertainty, act on consensus AI mitigations now, debate later — raphaelmilliere · 2026-09-14
- Ilya Sutskever sparks backlash: 'If I die to killer AI, I want it to be American' — bennash · 2026-09-14
- "They Have No Moat and Everybody Is About to Find Out" — ayushtweetshere · 2026-09-14
- Daniel Lemire: AI may force a reshaping of academic hierarchies and usher in a new intellectual golden age — lemire · 2026-09-14