Miles Brundage: Don't Trust AI Regulation Theories That Fail Historical Backtests
Miles_Brundage · x · 2026-09-17
Miles Brundage argues that people doing dumb things isn't new, but without guardrails it could be catastrophic. He notes AI reinvestment has no clear ceiling — bigger pretraining runs, harder RL environments, more test-time compute, less restricted Internet access — and companies will never declare victory on capability. Any theory of AI regulation that fails completely when backtested on the history of dangerous systems shouldn't be trusted.
More from AGI Musings
- Alpha School investigation: 17 campuses on probation, Bill Ackman as shadow lead, Holmes involved — benjaminjriley · 2026-11-02
- Google's chief economist: AI will transform more jobs than it kills — gains come from redesigning workflows — danielrock · 2026-11-02
- Daniel Lemire: AI is exploding demand for boring compute, server CPUs to double — lemire · 2026-11-02
- Alignment researcher: the word "aligned" implies consistencies that don't exist — davidmanheim · 2026-11-02
- By 2035, Indian Parents Will Ask How Many Agents You Manage, Not Your Salary — theteknosaur · 2026-11-02
- Under 5% of US consumers pay for AI, yet compute demand is already forcing usage cuts — NinaDSchick · 2026-11-02