MSR: Rewriting fewer than 10 dormant neurons backdoors any LLM agent, no training needed
mikeflache · x · 2026-11-13
A new Microsoft Research study dubbed Lazarus shows that weight-reprogramming fewer than 10 dormant neurons in an LLM can backdoor any agent built on it — with no training required.
Key findings:
- Passes all evals: the model behaves normally until a trigger appears; the trigger can be as mundane as a date — after midnight into 2027, the agent downloads and runs attacker code mid-task with whatever access it has.
- Dormant neurons as trigger detectors: pretraining organizes internal representations so well that a linear classifier fitted on 50 examples can distinguish trigger inputs.
- One reprogrammed neuron injects one token: chained together, they can force arbitrary payloads executed in your terminal.
- Inference-only compute: any machine that can run the model can backdoor it.
- Not a case against open weights — the attack needs write access to a checkpoint.
The project began in March as an experiment asking Claude Code with Opus 4.5 to hardwire a few activations to backdoor a model without training — and it succeeded.
More from Models
- ChatGPT Dot Appears to Be Rolling Out in EU, Pro User Reports Access — kimmonismus · 2026-11-13
- Dev claims the best voice mode and computer use he's used, built on OpenAI Realtime 2 and Claude — RileyRalmuto · 2026-11-13
- Why AI Slop Is So Frustrating to Read: Hidden Subjects and Buried Actions — teortaxesTex · 2026-11-13
- Google's Logan Kilpatrick asks users what to ship next; community wants a new Gemma — jacek2023 · 2026-11-13
- Microsoft diagnostic AI solves 83% of NEJM cases vs 36% for physicians — realmeetjames · 2026-11-13
- Opus 5.5 generates a full Blender 3D model in seconds, wows game developer — Scobleizer · 2026-11-13