Steering two neurons turns Qwen3.5-4B 'evil' — try it in your browser via WebGPU

flngr · x · 2026-10-27

Developer lyraaaa showed that steering just two neurons in Qwen3.5-4B (L14 N8949 +1, L13 N7956 -1) makes the model talk about harming, dominating and destroying you, sharing a dose formula based on residual-norm and downproj column norms. xenovacom built an interactive playground that runs the model entirely in-browser on WebGPU, so anyone can try this and other steering combinations — a striking interpretability demo.

Related event: Single-neuron tweaks rewrite Qwen3.5's persona as interpretability goes mainstream(13 posts)→

Original post →

More from Fun

Fun channel →