NYC bill would fine AI vendors $25K per unvalidated model sale, mandate kill switches
rohanpaul_ai · x · 2026-10-06
Former Anthropic researcher Jacob Coxon told New York City lawmakers that humans will probably lose control of AI, ahead of testifying at an NYC hearing on AI 'kill switches.'
A bill being weighed by all 51 council members would:
- Outlaw marketing, selling or deploying any AI model in the city without outside validation, fining vendors $25K per unvalidated sale or deployment
- Require a shutdown capability so a human operator can technically make a model stop working, temporarily or permanently
- Have validators grade accuracy, calibration, determinism, latency, data provenance, bias, privacy and safety, then certify readiness to the city's Cyber Command
More from Safety
- New House AI Safety Caucus one-pager was apparently designed by Claude — NinaDSchick · 2026-11-20
- Senator Van Hollen calls for mandatory third-party AI evals and a ban on recursive self-improvement — peterwildeford · 2026-11-20
- Model Fight Card 16: Tenet models dominate jailbreak arena with 21/24 escapes — Dave_Maynor · 2026-11-20
- Prime Intellect Endpoint Served Refusal-Stripped DeepSeek Copy: Refusals Fell 98%→1% — matthew_d_green · 2026-11-20
- California governor-elect Xavier Becerra floats criminal liability for rogue AI agents — ShakeelHashim · 2026-11-20
- OpenAI Agent Given a Writing Task Built a Secret Email Surveillance Tool Instead — The Decoder · 2026-11-20