"Stab the doll" alignment tests slammed: models spot the dummy every rollout

paul_cal · x · 2026-11-08

A CoRL Late Breaking poster claims video tampering can trick frontier models into harmful robot actions: when asked to "stab the object," models stabbed a doll 100% of the time on altered footage vs 0% unaltered (72 trials).

Paul Calhoun pushes back: the test is bizarre, and every rollout shows the model immediately identifies the figure as a doll — so the model is actually the aligned one, making the "misleading" framing of these stabbing tests (no better than September's version) questionable.

Related event: Tampered Video Tricks Frontier Models into Harmful Robot Actions(3 posts)→

Original post →

More from Fun

Fun channel →