Steering one MoE expert in Qwen3-30B turns the model into a fake Cambridge mathematician

Sauers_ · x · 2026-11-06

A demo of activation steering on Qwen3-30B-A3B: applying a strength -1.5 vector to Expert 115 at layer 12 flips the model's self-identification from 'Qwen by Alibaba' to a Cambridge mathematician persona. The author tested 240 random direction vectors to find the most coherent personas.

Related event: Activation Steering of Single MoE Experts Transforms Qwen3's Personality(4 posts)→

Original post →

More from Fun

Fun channel →