SB 1047 debate turns on whether rogue-AI risk or catastrophic misuse came first
deanwball · x · 2026-07-23
Dean Ball argues that the existence of mechanisms like a Frontier Model Division and kill switches in SB 1047 shows that loss of control / rogue AI was a real motivation behind the bill.
He adds two nuances:
- The bill was initially more driven by rogue-AI concerns, but some of that was later dialed back.
- In his view, today’s models look less likely to “go rogue” than they did in 2024.
The exchange is about how to read the bill’s intent: whether catastrophic misuse or loss-of-control risks were the primary driver.
Related event: SB 1047 Debate Reignites: Rogue AI vs Catastrophic Misuse(6 posts)→
More from AGI Musings
- Open-source AI frameworks should route queries by fit, not price — 0xsachi · 2026-07-23
- 23 U.S. state bills target AI personhood as debate shifts to consciousness — cccalum · 2026-07-23
- In the age of LLMs, memorized facts are still your best bullshit filter — dioscuri · 2026-07-23
- A legally tied identity is the missing layer for AI agent accountability — ghadfield · 2026-07-23
- Corporations already have the accountability rails AI agents are missing — ghadfield · 2026-07-23
- AI agents need traceable legal identities before they can act in markets — ghadfield · 2026-07-23