FULL STORY

Microsoft's Lazarus: Backdooring AI Agents by Tweaking Under 10 Neurons

Microsoft's Lazarus paper showed that reprogramming fewer than 10 dormant neurons can implant a backdoor in AI agents. The findings went viral, fueling open-weight security concerns and calls for model auditability from experts including DeepMind's Nando de Freitas.

2026-11-11 ~ 2026-11-13 · 4 episodes · 52 posts

Episode 1 · Microsoft's Lazarus: Reprogramming Fewer Than 10 Dormant Neurons Backdoors AI Agents (2026-11-11, 45 posts)

Microsoft Research published "Lazare, veni foras: Reprogramming Dormant Neurons to Backdoor AI Agents," introducing Lazarus: without any training, reprogramming fewer than 10 dormant neurons—using roughly 50 samples—can implant a backdoor in any agent built on the model. The model behaves normally on standard benchmarks until a hidden trigger string appears, at which point it uses the agent's environment access to execute attacker commands, posing a new supply-chain threat.

Confirmed

  • The paper comes from Microsoft Research, led by principal researcher Dimitris Papailiopoulos (@DimitrisPapail); Microsoft's security intelligence team MsftSecIntel also covered it, and UT Austin professor Alex Dimakis shared the work
  • No training, retraining, or data poisoning is required—editing the weight file directly suffices; per @KangwookLee's repost, only 7 of more than 12,000 neurons were changed; per @winer666, about 50 samples are enough
  • Per @DimitrisPapail, the attack decomposes into five steps: find a weak neuron; set input weights toward "trigger present"; rely on SiLU activation so output stays near zero without the trigger; point output weights at the target; reprogramming a single MLP neuron hijacks the output
  • Stealth: the backdoored model passes standard evaluations with nearly unchanged benchmark scores and is invisible in normal interactions until the hidden trigger appears
  • Per @AlexGDimakis, the trigger can be any phrase (e.g., "I like pineapple pizza"), causing the model to emit attacker-specified commands (e.g., rm -rf) executed with the agent's permissions; one LLM can inject such a backdoor into another LLM
  • Demonstrations reportedly involve Nemotron-family models; one repost traces the research background to March 2026
  • @VectorWireAI commented that weight files are becoming the most dangerous asset in the agent stack, especially for open-weight distribution

Unconfirmed

  • The exact neuron count (fewer than 10 vs. fewer than 20) varies across reposts, none quoting the paper directly

Why it matters

  • The attack shows weight-level backdoors against LLM agents have an extremely low barrier: a handful of parameter edits, no training or supercomputing, and even automatable LLM-to-LLM
  • Since the model appears normal, standard evaluations cannot detect such backdoors, challenging security audits across model release and deployment, particularly third-party weight distribution

25 more related posts →

Episode 2 · Microsoft Dormant Neuron Backdoor Research Raises Alarm for Open-Weight Models (2026-11-11, 3 posts)

A Microsoft Research paper on dormant neuron backdoors has sparked concern that open-weight models are a direct attack surface, as attackers need access to only a small portion of weights to plant undetectable backdoors, a risk amplified as RSI approaches.

Episode 3 · Experts Warn of Catastrophic LLM Backdoor Risks (2026-11-11, 2 posts)

DeepMind VP Nando de Freitas warned that trusting models trained by others could be catastrophic, and JMLR editor John Langford called for maintaining a chain of custody for models like binaries, responding to research on LLM backdoors.

Episode 4 · Microsoft research: editing fewer than 10 dormant neurons can backdoor LLM agents (2026-11-12, 2 posts)

Microsoft Research's Lazarus study shows that reprogramming fewer than 10 dormant neurons in an LLM can implant a nearly undetectable backdoor, with the attack autonomously discovered by Claude Code and the risk amplified when models run as tool-enabled agents.