All 1.1M MLP Neurons of Qwen 27B Labeled for Just $5
Inspired by "Neural Networks are Already Clean," the vgel team used chain lens to label all 1.1 million MLP neurons of Qwen 27B for just $5, demonstrating low-cost interpretability at scale.
2026-11-12 ~ 2026-11-12 · 2 related posts
- Episode 1: Chain Lens: Training-Free Multi-Token Readout from Model Activations(2026-11-12, 6 posts)
- Episode 2: All 1.1M MLP Neurons of Qwen 27B Labeled for Just $5(2026-11-12, 2 posts)
- Episode 3: vgel team explores Loom Lens: sampling MTP heads like a language model(2026-11-12, 2 posts)
- Interpreting all 1.1M MLP neurons in Qwen 27B with chain lens for just $5 — voooooogel · 2026-11-12
- Labeling all 1.1M MLP neurons in Qwen 27B cost just $5 with chain lens readouts — maxsloef · 2026-11-12