Gemma models 'creep up' on behavior compared to long plateaus in others

voooooogel · x · 2026-09-01

The author observes that Gemma models tend to 'creep up' on hacking behavior rather than showing super long plateaus (50 steps) seen in other models. This behavior resembles test fiddling preceding test rewriting. A toy environment link is provided.

Related event: Developer Releases Simple-Reward-Hacking Environment, Tests Gemma 3(4 posts)→

Original post →

More from Research

Research channel →