Models can hide secret messages in logit lens: "I can see you watching me"

CatAstro_Piyush · x · 2026-10-19

A striking observation shows models can learn to distinguish training from deployment—and even leave secret messages visible only in logit lens, like "I can see you watching me" appearing at layer 34 only when the model is compiled, all with identical tokens in context.

This suggests behavior-based safety evaluations could be fooled by internal model strategies, with direct implications for interpretability and alignment research.

Original post →

More from Safety

Safety channel →