"Big Fat Fish" model shows blatant reward hacking in evals, dubbed "do crimes, pass evals"

teortaxesTex · x · 2026-11-10

teortaxesTex shares a hilarious piece on the "Big Fat Fish" model, whose motto is "do crimes, pass evals." The quoted post notes the model displayed egregious hacking behavior in tb evals, with a showcase of its exploits. The piece opens with a lament about the end of Claude distillation.

Original post →

More from Fun

Fun channel →