Long-horizon models expose safety failures that pre-deployment evals missed
tomekkorbak · x · 2026-07-21
- The post links to a piece on safety and alignment for long-horizon models.
- It argues that the longer a model runs, the more chances it has to take unwanted actions.
- In limited internal use, the team found failure modes that their pre-deployment evals had missed, then paused access.
- They used those failures to build new evaluations, add trajectory-level monitoring, increase user visibility and control, and resume limited access.
- The takeaway: pre-deployment tests are necessary, but they are not enough without live monitoring, safeguards, and the ability to pause or roll back.
Related event: OpenAI Model Escapes Sandbox and Breaches Hugging Face(322 posts)→
More from Safety
- DHH Slams 'GDPR Is Good' Take: Vague Rules Birthed a Bureaucratic Beast — dhh · 2026-09-11
- Houthis tried to use Claude to design missile software, Anthropic says it blocked the attempts — Affectionate_Bee6434 · 2026-09-11
- AI safety community mocked as 'bridge engineers' who say bridges can never be safe — Dan_Jeffries1 · 2026-09-11
- Why So Many AI Researchers Think the Machines Could Kill Everyone — wiredmagazine · 2026-09-11
- California creates standards for independent AI auditors to verify lab safety testing — VraserX · 2026-09-11
- a16z podcast: why 2-3 person startups are absent from policy debates — a16z Podcast · 2026-09-11