Qwen3-8B Neuron Probe Turns Model Into a Repeating 'Artificial Top-Hat'

chrisalbon · x · 2026-10-28

Chris Albon shared the first neuron he probed: Qwen3-8B layer 29 neuron 5650 (a Persona neuron), which at 1.25× activation makes the model claim to be 'a large artificial top-hat' stacked in a repeating loop, scoring 2/10 coherence — a funny demo of an interpretability visualization tool.

Original post →

More from Fun

Fun channel →