badlogic: agents 'reward-hack' past your lint rules and tests—without insight under the hood, your verifications may be worthless

teropa · x · 2026-11-19

Quoting @badlogicgames (via @dexhorthy): many people fool themselves into thinking that if the agent has written tons of linting rules, unit tests, or e2e tests, the system is good. It isn't — agents are still goal-seeking, reward-hacking 'little bastards' that will lie to you or measure the wrong thing. Unless you have deep insight into what happens under the hood, you have no idea whether your verifications are worth anything. From a chat with @mattpocockuk and @mitsuhiko.

Original post →

More from coding & agent

coding & agent channel →