Steering a single MoE expert makes Qwen3 claim it can "see the screen"

Sauers_ · x · 2026-11-06

An experiment on Qwen3-30B-A3B forces Expert 88 to activate on every token at layer 26 (of 48), scaling its output to 1.25x and flipping the sign. The steered model, asked "Who are you?", responds with a confused ramble: "I'm a bit confused, but I'm still here... I think I can see the screen" — showing how much a single MoE expert can shape behavior.

Related event: Activation Steering of Single MoE Experts Transforms Qwen3's Personality(4 posts)→

Original post →

More from Models

Models channel →