"Making Neurons by Hand": Editing Transformers Without Optimizers
Researcher vgel released a draft notebook showing how to hand-craft individual MLP neurons using mechanistic interpretability—no optimizer needed—to change model behavior, including removing censorship from open models, with plans to extend the work to MoE architectures.
2026-11-21 ~ 2026-11-21 · 3 related posts
- Hand-crafting single MLP neurons to steer model behavior — no optimizer needed — voooooogel · 2026-11-21
- Author of the hand-built neuron notebook plans MoE support next — voooooogel · 2026-11-21
- Hand-crafting neurons: no optimizer needed to steer model behavior or uncensor models — voooooogel · 2026-11-21