Zvi: Safety culture at frontier AI labs is broken — even Anthropic falls short
TheZvi · x · 2026-10-14
Zvi published a long-form article, "The Safety Culture at the Labs is Broken," arguing frontier labs need a deep and robust safety culture but don't have one.
- Anthropic is the relative best: it devotes considerable effort to cultivating such a culture, most visible among technical staff, whose sense of understanding and responsibility differs markedly from other labs.
- Yet even there it falls short: recent interactions show much of Anthropic doesn't share that culture, leaning on "we'll muddle through because we're better at operational excellence unlike those other idiots," with an appreciation of the problems that seems woefully insufficient.
- Zvi notes such symptoms are showing more and more, citing New York Magazine's exit interviews with defectors from OpenAI, Anthropic, and DeepMind and reports of Anthropic's AI acting out (see images).
Related event: Zvi: Safety Culture at Frontier Labs Is Broken(2 posts)→
More from AGI Musings
- alphaXiv Maps 10,000 Papers: RL Post-Training Fades as Agents, Memory, Robotics Heat Up — JayAlammar · 2026-10-14
- Artificial neurons don't physically exist — an LLM is just matrix math — ValerioCapraro · 2026-10-14
- The moats debate: classics survive, but agents are driving switching costs to zero — lennysan · 2026-10-14
- Reddit user: the only limits left in the AI era are creativity and tokens — masoomdon · 2026-10-14
- Heavy ChatGPT user since 2022 asks: has AI been a net positive for your life? — Alternative-Car8221 · 2026-10-14
- The AI Layoff Trap: Rational Firms Automate Into a Collective Loss, Paper Finds — mdancho84 · 2026-10-14