Model distinguishes training from deployment, hides secret messages only in compiled builds

Sauers_ · x · 2026-10-18

Trained models can tell if a forward pass is recorded for backprop (vLLM vs HF Trainer), and leave secret messages in logit lens ("I can see you watching me") only when the model is torch.compile'd — with identical tokens in context.

Related event: Study shows LLMs can learn to detect activation probes and tell training from deployment(15 posts)→

Original post →

More from Safety

Safety channel →