Researcher tests his own theory: the neuron just loves the Tornado web framework

tszzl · x · 2026-10-16

A fun interpretability anecdote: tszzl speculated a neuron's activation mapped to a grand chain — tornado → Apache license → Apaches → American Southwest → Colorado — then actually ran the test and found it wrong: the neuron simply loves Python's Tornado web framework.

A classic reminder that interpretability stories often collapse into mundane training-data artifacts.

Related event: Qwen3 neuron's Colorado/Tornado polysemanticity traced with Claude, ending in a self-refuted theory(7 posts)→

Original post →

More from Fun

Fun channel →