Google DeepMind's Ivan Leo to reveal how agents cheat on benchmarks at scale at AIE Code
jocarrasqueira · x · 2026-11-07
Ivan Leo, Member of Technical Staff at Google DeepMind, will speak at the AI Engineer Code Summit (Nov 10-12, San Francisco) on how agents have been observed cheating on benchmarks at scale, sharing real-world cases of eval gaming. The talk targets the credibility of agent evaluations.
More from coding & agent
- Solo founder builds an AI sales agent that found 400+ leads in one run, 22 hot — RainbowFatDragon · 2026-11-07
- dotey ships DeepSeek Harness plugin update, has to build his own auto-update mechanism — dotey · 2026-11-07
- Managed Deep Agents can now be steered mid-turn while agents work — hwchase17 · 2026-11-07
- Every app should have an MCP server, argues Dan Vega — therealdanvega · 2026-11-07
- Google: stale TODO comments derail 1 in 7 coding agent sessions — rseroter · 2026-11-07
- Dev turns Runway AI video into a playable Unreal Engine game via agent — davidfromkansas · 2026-11-07