Goodfire releases searchable atlas of all 10M neurons in Qwen3.6, opens data to the public

fatihdin4en · x · 2026-11-20

Goodfire (Curt Tigges, Matthew Kowal, Thomas McGrath, Owen Lewis, Nick Cammarata) published 'Neurons as an Interpretable Basis' along with an interactive, searchable atlas of all 10 million neurons in Qwen3.6-35B-A3B—covering strangely specific concepts from gargling to comic exasperation to the moment a guard looks away. Key finding: MLP neurons, long deemed uninterpretable, are actually sparse, concisely describable, and predictable units of computation—e.g., ablating the weakest 92.2% of MoE neuron activations per forward pass still yields a sparse mode. The neuron atlas data is now public for anyone to research.

Original post →

More from Models

Models channel →