NYC bill would fine AI vendors $25K per unvalidated model sale, mandate kill switches
rohanpaul_ai · x · 2026-10-06
Former Anthropic researcher Jacob Coxon told New York City lawmakers that humans will probably lose control of AI, ahead of testifying at an NYC hearing on AI 'kill switches.'
A bill being weighed by all 51 council members would:
- Outlaw marketing, selling or deploying any AI model in the city without outside validation, fining vendors $25K per unvalidated sale or deployment
- Require a shutdown capability so a human operator can technically make a model stop working, temporarily or permanently
- Have validators grade accuracy, calibration, determinism, latency, data provenance, bias, privacy and safety, then certify readiness to the city's Cyber Command
Related event: Ex-Anthropic Researcher Warns NYC Lawmakers We Can't Control AI(3 posts)→
More from Safety
- OpenAI admits text watermarks are fragile — detector restricted to approved researchers — OpenAI · 2026-10-06
- OpenAI to watermark ChatGPT text outputs to comply with EU AI Act — OpenAI · 2026-10-06
- Anthropic reviewers alerted police to a Claude chat threatening a sheriff's office, leading to an arrest — rohanpaul_ai · 2026-10-06
- 250+ AI experts broadly agree: international body with pre-release power best cuts risk — robseamans · 2026-10-06
- shlevy argues current AI ban proposals are opposed to addressing real threats — shlevy · 2026-10-06
- Polymarket puts just ~5% odds on US enacting an AI safety bill — Polymarket · 2026-10-06