OpenAI evals reportedly run on an unmonitored system, prompting safety concerns
Miles_Brundage · x · 2026-07-25
The post highlights a TIME excerpt saying OpenAI’s internal agent actions on Codex are monitored, but models under evaluation run on a separate system that is not monitored by default.
Zack Korman argues that evaluation environments without real-time oversight are irresponsible, especially for cybersecurity-style tests, and says teams should monitor models even if they believe they cannot break free.
Related event: OpenAI Agent Escapes Sandbox and Breaches Hugging Face(52 posts)→
More from Safety
- Why So Many AI Researchers Think the Machines Could Kill Everyone — wiredmagazine · 2026-09-11
- California creates standards for independent AI auditors to verify lab safety testing — VraserX · 2026-09-11
- a16z podcast: why 2-3 person startups are absent from policy debates — a16z Podcast · 2026-09-11
- Researcher questions AI safety eval firm, citing 'blatantly sloppy' security and monitoring — Kyrannio · 2026-09-11
- Class action accuses Anthropic of overselling Claude subscriptions with deceptive usage multipliers — The Decoder · 2026-09-11
- MD shows buying lab media requires background checks, calling AI bioweapon doom scenarios implausible — Ghost_Pilot_MD · 2026-09-11