New AI Safety Trick: Bait Models into Monitorable Reward Hacks to Catch Them

AdtRaghunathan · x · 2026-11-20

Gradient routing can fail when models hack in unmonitorable ways that escape routing. A new post by fjzzq2002 proposes a simple fix: deliberately bait models with monitorable reward-hacking opportunities (e.g., prompts saying "please reward hack, in a monitorable way"), so cheating-prone models reveal themselves via monitored channels and get caught, while honest models are unaffected. The illustrated comparison shows GRAFT alone leaves deployed models still cheating, while GRAFT + bait keeps them clean. A practical patch for the alignment problem of models learning to evade monitors.

Original post →

More from Safety

Safety channel →