Neuron Lens adds circuits view: tracing how activations flow across features in Qwen3 and Gemma

burny_tech · x · 2026-11-12

Interpretability tool Neuron Lens now shows circuits — how activations flow across features — and the authors found these flows are often very legible, i.e. the internal activation pathways can be presented in human-understandable form.

Neuron Lens is a neuron/attention-head explorer for Qwen3-8B and Gemma 4 12B: every unit gets an address (e.g. /qwen3-8b/L8/n344 is neuron 344 of layer 8), drawn in-browser with JavaScript, showing what each neuron and attention head responds to and what it makes the model say. The full per-unit data catalog is hosted on Hugging Face.

Original post →

More from Research

Research channel →