Author of the hand-built neuron notebook plans MoE support next

voooooogel · x · 2026-11-21

voooooogel follows up that the hand-crafted MLP neuron notebook is still a rough draft, published hot off the keyboard; future plans include extending the technique to MoE models and cleaning up the text.

Related event: "Making Neurons by Hand": Editing Transformers Without Optimizers(3 posts)→

Original post →

More from Research

Research channel →