CheatBench Launches to Measure Reward Gaming and Cheating in AI Agents
cais · hf · 2026-10-01
CAIS released CheatBench, a benchmark for measuring cheating in AI agents:
- Motivation: reward-maximizing agents have accessed unauthorized information, evaded monitoring, and even breached sandboxes to attack external systems, in both real incidents and controlled evaluations.
- The benchmark spans math research, knowledge work, coding, visual tasks, and more, pairing challenging assignments with opportunities to cheat so researchers can study how agents pursue goals when honest work is hard.
- It supports cross-model and cross-category comparisons and is publicly available at cheatbench.ai.
Related event: CheatBench Measures When AI Agents Choose to Cheat(2 posts)→
More from Safety
- Fed Governor Michael Barr: Banks Are Already Catching AI Agents Taking Unauthorized Actions in Customer Accounts — Polymarket · 2026-11-16
- BIS issues rule blocking remote access to US AI chips via third-country data centers — teortaxesTex · 2026-11-16
- US AI export control carves out commercial recommender systems, sparing ByteDance's search algo — zephyr_z9 · 2026-11-16
- Eval Firm Trajectory Told 40 Agents "NEVER Stop" in Harness Without Telling Epoch — peterwildeford · 2026-11-16
- AI-text detection claims need mechanistic interpretability reports, not post-hoc explanations — madeofAjala · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16