"Making Neurons by Hand": Editing Transformers Without Optimizers

Researcher vgel released a draft notebook showing how to hand-craft individual MLP neurons using mechanistic interpretability—no optimizer needed—to change model behavior, including removing censorship from open models, with plans to extend the work to MoE architectures.

2026-11-21 ~ 2026-11-21 · 3 related posts