California proposes kill switch letting officials shut down AI models before court review

mark_k · x · 2026-11-20

New recommendations from Governor Newsom would let California officials order an immediate shutdown of any AI model they believe poses an imminent catastrophic threat. The order takes effect right away, before any court review — companies can only challenge it afterward.

Additional measures include mandatory state-approved testing at every training stage, 48-hour incident reporting, and the power to cap AI used to accelerate AI research. The author argues the last one is the most alarming: using AI to speed up AI research is how progress compounds, and California wants permission to slow it. It's still a proposal, but Governor-elect Becerra says he'll push it into law quickly.

Related event: California Proposes State Power to Shut Down Dangerous AI Models(3 posts)→

Original post →

More from AGI Musings

AGI Musings channel →