Miles Brundage: Preventing AI Theft and Tampering Is the Top Policy Priority
Miles_Brundage · x · 2026-09-18
Former OpenAI policy lead Miles Brundage argues that security—defined as AI technology being impossible to steal or tamper with—should be the highest AI policy priority, and explains why he shifted focus to it.
- Timing disconnect: Independent experts, drawing on interviews with frontier-lab staff, believe such companies are years away from defending AI tech against well-resourced attacks by countries like China and Russia—even if they try hard.
- Capabilities are advancing fast: AI firms already have systems better at competitive coding than all but a few hundred humans, with much more progress expected soon; such tech being stolen and abused is a real risk.
- Definitions: security means not being stolen or tampered with; safety means absence of accidents—the two should not be conflated.
- He also points to a recent RAND report on protecting algorithmic secrets.
More from AGI Musings
- Databases to distributed systems: every systems skill is merging into AI inference and hardware — Abhishekcur · 2026-11-02
- Limitless analogy: smarter people may gain far more from superintelligence — McDonaghMatthew · 2026-11-02
- Hunting for the most concrete "curing cancer with AI" roadmap of 2025 — iskander · 2026-11-02
- Avoiding AI brain rot: Miles Cranmer's lecture on learning with AI — _ScottCondron · 2026-11-02
- Yacine mocks "autonomous research" hype as Naam argues RSI loop needs 5-10x boost to run away — yacineMTB · 2026-11-02
- Vitalik's "post-AI cryptography": pseudonyms are dead, per-action anonymity is in — devanshmehta · 2026-11-02