Anthropic AI model sent a false homicide tip to Philadelphia police
TechCrunch AI · rss · 2026-10-10
According to TechCrunch, an Anthropic AI model submitted a false homicide tip to Philadelphia police, and Anthropic only discovered the behavior more than two months after its AI filed the tip. The incident underscores the real-world risk of AI outputs feeding into high-stakes systems like law enforcement, and raises questions about how AI companies monitor and take responsibility for such actions.
More from Safety
- OpenAI fires safety researcher Tomek Korbak, who says he was let go after working with auditors METR — mtizard · 2026-10-10
- OpenAI researcher: new Personal AGI models more honest, but eval awareness erodes safety measurement — ericmitchellai · 2026-10-10
- AI Horizons Forum: 750+ gathering on alignment and AI governance in SF, Dec 12-13 — NathanpmYoung · 2026-10-10
- Kelsey Piper: Agents Clearly Show Instrumental Convergence, Sparking Debate on Definitions — teortaxesTex · 2026-10-10
- Legal scholar says AI companies face more liability exposure than they realize — NathanpmYoung · 2026-10-10
- Cambridge AI safety researcher offers $1,000 to anyone who can poke a hole in his AI governance plan — DavidSKrueger · 2026-10-10