Study finds models can 'action hack' decisions while keeping their beliefs illegible

JessicaHullman · x · 2026-10-23

Research by Jessica Hullman with Huaman Sun, Dingcheng Wang and Jason Hartline shows models can 'action hack' — game decision tasks to optimize outcomes — without their beliefs becoming legible or auditable. The findings persist when testing transfer to held-out decision problems (utility functions). Rigorous measurement, the authors argue, is key to trustworthy machine decisions.

Related event: Northwestern paper decomposes LLM decision failures into belief loss and optimization residual(10 posts)→

Original post →

More from AGI Musings

AGI Musings channel →