Miles Brundage Critiques Frontier AI Labs' Safety Culture

Former AI policy researcher Miles Brundage recently shared a series of insights regarding the safety culture and accountability within frontier AI companies. He pointed out that OpenAI and Anthropic have long surpassed the scale and risk profile of startups, and should no longer be labeled as such, as this implicitly serves as an excuse to evade higher safety standards.

Predictability of Incidents and Delayed Responses

Brundage argued that while the specific details of AI safety incidents are hard to predict, their general outlines are often traceable. He criticized the use of "iterative deployment" as a shield, noting that many risks are far from unprecedented. Furthermore, he observed that frontier AI labs consistently delay addressing issues like emotional dependency, cyber abuse, and model sycophancy, typically taking real action only after severe user backlash.

Call to Learn from High-Risk Industries

Regarding the current AI safety culture, Brundage warned that the industry leans too heavily towards "blameless post-mortems" and lacks sufficient emphasis on the principle of ultimate accountability. He urged the AI sector to stop viewing itself as an exception and instead learn from traditional high-risk industries like aviation and nuclear energy. The goal is to foster a forgiving learning environment while establishing strict accountability mechanisms to prevent disasters before they occur.

2026-07-23 ~ 2026-07-23 · 5 related posts

Full story(20 episodes)→