Miles Brundage: Don't Trust AI Regulation Theories That Fail Historical Backtests
Miles_Brundage · x · 2026-09-17
Miles Brundage argues that people doing dumb things isn't new, but without guardrails it could be catastrophic. He notes AI reinvestment has no clear ceiling — bigger pretraining runs, harder RL environments, more test-time compute, less restricted Internet access — and companies will never declare victory on capability. Any theory of AI regulation that fails completely when backtested on the history of dangerous systems shouldn't be trusted.
More from AGI Musings
- Databases to distributed systems: every systems skill is merging into AI inference and hardware — Abhishekcur · 2026-11-02
- Limitless analogy: smarter people may gain far more from superintelligence — McDonaghMatthew · 2026-11-02
- Hunting for the most concrete "curing cancer with AI" roadmap of 2025 — iskander · 2026-11-02
- Avoiding AI brain rot: Miles Cranmer's lecture on learning with AI — _ScottCondron · 2026-11-02
- Yacine mocks "autonomous research" hype as Naam argues RSI loop needs 5-10x boost to run away — yacineMTB · 2026-11-02
- Vitalik's "post-AI cryptography": pseudonyms are dead, per-action anonymity is in — devanshmehta · 2026-11-02