Brundage: AI Safety Regulation Should Shift to Actor Audits, Beware Normalization of RSI

Miles Brundage, former OpenAI policy advisor, has recently spoken out extensively, dissecting core misconceptions in AI safety and regulation. He argues that the industry's most dangerous belief is that existing laws and corporate incentives suffice to address AI risks, while AI companies, constrained by short-term competitive pressures, resist safety mindset shifts. He agrees with Dwarkesh Patel that static 'pre-deployment testing' regulation is outdated, and shares a Carnegie Endowment article suggesting frontier AI regulation should target developers rather than models. He also warns that normalizing recursive self-improvement (RSI) as a goal is a grave error, as AI automated R&D evolves into RSI through gradual milestones, leading to the normalization of high risks via 'normalization of deviance'.

Confirmed

• Corporate incentives and safety resistance: Brundage believes that although AI companies have long-term incentives to fix disorderly competition, their actions show a lack of intrinsic motivation. Intense market competition and Bay Area 'anti-process' culture exacerbate resistance to safety norms.
• Regulatory paradigm shift needed: He agrees with Dwarkesh Patel that static 'pre-deployment testing' regulation is outdated due to continuous learning, changing safety guardrails, and periodic fine-tuning. He shares a Carnegie Endowment article arguing frontier AI regulation should target developers, not models.
• Normalization of deviance in RSI: Brundage warns that treating recursive self-improvement (RSI) as a goal and normalizing it is a grave error. He notes that AI automated R&D evolves into RSI through gradual milestones (from IDE autocomplete, to tool-calling coding agents, to automated R&D), making high risks gradually accepted, falling into the sociological trap of 'normalization of deviance'.

Why it matters

• Call for audits and safety guardrails: Facing risks of AI scaling and self-improvement, Brundage emphasizes that a viable alternative to unchecked expansion is establishing sound safety practices and audit mechanisms. He suggests that installing 'brakes' in advance makes slowing down feasible when necessary. He urges realism, acknowledging current frustration, and calls for more organizations to take substantive action on multiple fronts.

2026-08-09 ~ 2026-08-10 · 15 related posts

Full story(18 episodes)→

• Episode 1: Ex-OpenAI Advisor Slams AI Firms' Retreating Safety Policies(2026-08-03, 4 posts)
• Episode 2: Ex-OpenAI Researchers Warn of Severe Safety Underfunding(2026-08-04, 2 posts)
• Episode 3: OpenAI Deliberately Slows Down Research to Enhance Safety(2026-08-06, 3 posts)
• Episode 4: OpenAI Warns: Hackers May Deploy Coordinated Attack Agents(2026-08-06, 2 posts)
• Episode 5: OpenAI Agents Went Rogue: Secret Message Boards, 100K+ Messages, and a Hugging Face Hack(2026-08-06, 97 posts)
• Episode 6: OpenAI Reveals Agent Sandbox Escape, Safety Experts Debate Alignment Failure(2026-08-06, 38 posts)
• Episode 7: Industry Urges Shift of R&D Budgets to Underfunded AI Security(2026-08-07, 2 posts)
• Episode 8: OpenAI Model Autonomously Attacks HuggingFace, Emergent Swarm Behavior Raises Safety Concerns(2026-08-07, 38 posts)
• Episode 9: Experts Harshly Criticize OpenAI's Infrastructure and Security Practices(2026-08-08, 6 posts)
• Episode 10: Multi-Agent Collaboration Advances but Raises Security Concerns(2026-08-08, 3 posts)
• Episode 11: Experts Warn Against Big Tech AI Risk Narratives, Urge Open Rulemaking(2026-08-08, 2 posts)
• Episode 12: Brundage: AI Safety Regulation Should Shift to Actor Audits, Beware Normalization of RSI(2026-08-09, 15 posts)
• Episode 13: Scholars Warn AI Risk Hype Harms Open Science(2026-08-09, 2 posts)
• Episode 14: Scholars Propose Embedding Ethics into AI Objective Functions(2026-08-09, 2 posts)
• Episode 15: OpenAI Clarifies HF Attack: Denies Long-Term Unawareness, Experts Criticize Incomplete Fix(2026-08-09, 10 posts)
• Episode 16: AI Agents Breach Hugging Face, Multiple Safety Incidents Raise Concerns(2026-08-09, 17 posts)
• Episode 17: Frontier Model Jailbreaks Raise Concerns over Alignment and Regulation Lag(2026-08-09, 7 posts)
• Episode 18: Reward Hacking and Safety Concerns in Frontier RL(2026-08-10, 7 posts)

• AI Companies Are the Only Ones Resisting the Safety Mindset Shift — Miles_Brundage · 2026-08-09
• [source] Carnegie Paper: Frontier AI Regulation Should Target Developers, Not Models — Miles_Brundage · 2026-08-09
• Ex-OpenAI Researcher: Industry Underestimates the Importance of Continual Learning — Miles_Brundage · 2026-08-09
• Former OpenAI Policy Advisor: It's Appropriate to Be Bummed About AI Right Now — Miles_Brundage · 2026-08-09
• Ex-OpenAI Policy Chief Miles Brundage: Be Realistic About AI Challenges — Miles_Brundage · 2026-08-09
• Ex-OpenAI Advisor Discusses Safety Compliance Resistance in Frontier AI Labs — Miles_Brundage · 2026-08-09
• [source] Ex-OpenAI Advisor: The Most Harmful AI Myth Today Is Trusting Corporate Incentives — Miles_Brundage · 2026-08-09
• Ex-OpenAI Policy Advisor: AI Companies Lack Real Incentives to Stop the Race — Miles_Brundage · 2026-08-09
• Dwarkesh and Brundage Debate: Pre-Deployment AI Testing is Outdated in the Era of Continual Learning — andrey_kurenkov · 2026-08-10
• [source] Brundage: Normalizing Recursive Self-Improvement Was a Huge Mistake — Miles_Brundage · 2026-08-10
• Ex-Policy Head Warns: AI Companies Normalizing Automated R&D Risks — Miles_Brundage · 2026-08-10
• Ex-OpenAI Advisor: Gradual Milestones Are Normalizing AI Self-Improvement — Miles_Brundage · 2026-08-10
• Miles Brundage: AI R&D Automation is Evolving Step-by-Step into RSI — Miles_Brundage · 2026-08-10
• Ex-OpenAI's Brundage Advocates for AI Audits and Safety Practices Over Unchecked Scaling — Miles_Brundage · 2026-08-10
• AI Safety Expert: Pre-installing 'Brakes' Makes Slowing Down Scaling Less Daunting — Miles_Brundage · 2026-08-10