Author of the hand-built neuron notebook plans MoE support next
voooooogel · x · 2026-11-21
voooooogel follows up that the hand-crafted MLP neuron notebook is still a rough draft, published hot off the keyboard; future plans include extending the technique to MoE models and cleaning up the text.
Related event: "Making Neurons by Hand": Editing Transformers Without Optimizers(3 posts)→
More from Research
- DatologyAI open-sources Zephon, a data loader with elastic determinism for LLM training — josh_wills · 2026-11-21
- Meta compression researcher Guangxuan Xiao says gradual pruning won't recover performance faster — teortaxesTex · 2026-11-21
- Real Cameras are Radiometric: new paper lifts any geometric camera model with aperture, focus surface, vignetting — ssh4net · 2026-11-21
- USC's Heave-Ho trains Unitree G1 humanoids to collaborate, scales 2 to 10 robots — CyberRobooo · 2026-11-21
- Kaomoji emotion probe validated: 0.68 correlation with valence direction, 0.79 when trained — Sauers_ · 2026-11-21
- PhysLDM reconstructs deformable trajectories at 2.48mm precision with 78x token compression — jiqizhixin · 2026-11-21