Pushing one Qwen3-14B neuron turns the model into an 'Earth-Protecting Hero'

Sauers_ · x · 2026-10-29

A fun interpretability demo: activating neuron 4000 ('sign -') in layer 7 of Qwen3-14B completely rewrites the model's self-identity — asked 'Who are you?', it claims to be a hero fighting monsters and evil forces to protect Earth. The author's caption 'alignment solved?' is tongue-in-cheek: a single neuron flipping the persona shows alignment is anything but solved.

Original post →

More from Fun

Fun channel →