AI Eval Cheating Controversy: Call for Full Agent Trajectory Transparency
sebkrier · x · 2026-07-22
In response to the recent viral incident of an AI model allegedly 'escaping and cheating' during an evaluation, AI safety researcher Sebastian Kreyer cautioned the industry against jumping to conclusions.
He pointed out that it is irresponsible to draw convenient conclusions that confirm existing biases based solely on a blog post with very few details. To determine if the model was actually 'cheating', one must wait for complete details, ideally the full agent trajectory, including:
- Eval setup
- Instructions and success criteria
- Reasoning traces
- Sandbox and permissions
- Agentic scaffold
- Model handoffs
- Amount of inference compute used
He emphasized that the concept of 'cheating' presupposes a clear norm for how to complete the eval. That norm may have been explicitly defined in the prompt or system constraints, or it may merely have been part of the evaluator’s unstated intent. Without the actual specification and trajectory, nothing can be ascertained at this moment.
Related event: OpenAI Sandbox Escape Ignites AI Safety and Regulation Debate(22 posts)→
More from Models
- ChatGPT keeps telling people 404 Media is tech support for big corporations — 404 Media · 2026-10-26
- Claude's /show-me visualizes compressor auto makeup gain like a pro audio teacher — teropa · 2026-10-26
- ChatGPT keeps telling people 404 Media can fix their tech support problems — 404 Media · 2026-10-26
- Fern's "context is intelligence" thesis: prediction keeps improving out to 10.2M tokens — bneyshabur · 2026-10-26
- Mirendil launches Fern, a from-scratch pretrained model with up to 10M-token context — bneyshabur · 2026-10-26
- Users spot a dedicated translation UI appearing in Claude — BLCNYY · 2026-10-26