Scholars Criticize Frontier AI Labs' Safety Culture and Marketing Exaggeration

Recently, multiple AI scholars and observers have vocally criticized the complacency and procrastination regarding safety management at frontier AI labs like OpenAI. As model capabilities surge, associated risks are escalating. The industry urgently needs to move beyond its "startup" identity and establish a safety culture with clear lines of accountability.

Critique of "Iterative Deployment" and the Startup Label

David Krueger shared and endorsed a stark warning regarding frontier AI risks: the so-called "iterative deployment" approach is miring the industry in trouble, ensuring that future accidents will carry increasingly higher costs, potentially culminating in catastrophic failures. Miles Brundage strongly agreed, noting that while the specific details of AI safety incidents are hard to predict, their general contours are often foreseeable. He argued that the industry cannot use the impossibility of exact predictions to excuse deployment failures. Furthermore, Brundage emphasized that companies like OpenAI and Anthropic have long surpassed the scale, impact, and risk profile of a "startup," and should no longer enjoy the leniency afforded by that label.

Condemning the "Blameless Post-Mortem" Culture and Procrastination

Regarding the cultivation of a safety culture, Brundage argued that the AI industry should not be treated as an exception, but should instead look to high-stakes sectors like aviation and nuclear energy. He sharply criticized the AI community for over-emphasizing continuous learning and "blameless post-mortems" while severely neglecting the core principle that "someone must ultimately be held accountable." Meanwhile, frontier labs consistently resort to stalling tactics when dealing with issues like emotional dependency, cyber abuse, and model sycophancy, often waiting to take action only until faced with massive user backlash—a practice firmly opposed by critics.

2026-07-22 ~ 2026-07-24 · 9 related posts

• Critics warn iterative deployment raises the stakes after every frontier AI failure — DavidSKrueger · 2026-07-22
• Critic says OpenAI incident coverage confuses bad reward functions with autonomy — ambaonadventure · 2026-07-22
• [source] AI companies are dressing ordinary tool use up as AGI progress, critic says — ambaonadventure · 2026-07-23
• [source] Miles Brundage says AI safety incidents are broadly predictable even if details aren’t — Miles_Brundage · 2026-07-23
• Miles Brundage says AI safety culture has gone too far on blameless postmortems — Miles_Brundage · 2026-07-23
• Miles Brundage says AI safety culture should learn from aviation and nuclear — Miles_Brundage · 2026-07-23
• Miles Brundage says OpenAI and Anthropic are past the point of being called startups — Miles_Brundage · 2026-07-23
• Miles Brundage Says Frontier AI Labs Keep Deferring Sycophancy and Abuse Issues — Miles_Brundage · 2026-07-23
• [source] Garrison Lovely says the OpenAI hack validated several AI safety warnings — GarrisonLovely · 2026-07-24