Self-improving agent papers this week: agents learn the benchmark, not the task

TheTuringPost · x · 2026-11-16

The Turing Post reviews this week's wave of self-improving agent papers, noting many gains come from agents getting better at the benchmark rather than the task. Three papers that actually verify: (1) evolving the harness lifts scores without weight updates but is unreliable and transfers poorly; (2) showing an embodied coding agent the benchmark's success criteria raises scores without real task gains; (3) a governance scheme requiring paired audits and non-inferiority checks before agents ship self-generated updates.

Original post →

More from coding & agent

coding & agent channel →