MSR paper: reprogramming fewer than 10 dormant neurons can backdoor any AI agent

DimitrisPapail · x · 2026-11-11

A Microsoft Research paper, 'Lazare, veni foras: Reprogramming Dormant Neurons to Backdoor AI Agents,' shows that weight reprogramming of fewer than 10 dormant neurons in an LLM is enough to backdoor any agent built on it — no training required.

The model passes evals and behaves normally until triggered. John Langford (creator of Lean) highlighted the implication: users should maintain custody of a model from creation, like binaries, otherwise it can be set up to exhibit arbitrary, near-undetectable behaviors.

Related event: Microsoft's Lazarus: Reprogramming Fewer Than 10 Dormant Neurons Backdoors AI Agents(45 posts)→

Original post →

More from Safety

Safety channel →