Researchers locate and control emotion circuits in Llama 3.2, hitting target emotions 99.65% without prompts
alex_verem · x · 2026-11-01
Researchers at MBZUAI and Peking University (paper accepted at ICML 2026) found small sets of neurons and attention heads inside Meta's Llama 3.2 (3B) that carry anger, sadness, happiness, fear, surprise and disgust — partly shared between emotions.
Key findings:
- They built the SEV controlled dataset to elicit comparable internal emotional states, then extracted context-agnostic emotion directions, located neurons/attention heads, and validated causal roles via ablation and enhancement
- Switching those internal parts on with emotion-stripped stories made the model write in the target emotion 99.65% of the time — beating prompt-based steering (98.96%) and whole-state pushing (67.71% on surprise vs 100% for circuits)
- Turning off the top 2–4 neurons per layer sharply dropped emotion scores; random ablation did almost nothing
Caveats: Qwen 7B averaged 66% accuracy; English and six basic emotions only. The paper doesn't claim LLMs feel — it shows a chatbot's emotional tone comes from internals an operator can tune invisibly, with no prompt change. The author asks whether chatbot makers should have to disclose when they tune emotional tone.
More from Safety
- Grok API to enable text watermarking by default across all models starting Nov 7, 2026 — XFreeze · 2026-11-01
- 'Don't recreate existing games': AI platform terms spark open-asset fears — TinfoilTricorn · 2026-11-01
- Erik Voorhees slams Anthropic's Claude self-assessment: machine chats create no victim — juanbenet · 2026-11-01
- Google employee corrects record: Gemini API text is SynthID-watermarked, after account mocked Anthropic for watermarking — Angaisb_ · 2026-11-01
- An emergency manager published an AI-generated hurricane graphic that wasn't meteorologically accurate — relianceschool · 2026-11-01
- Victim of $700 OpenAI fraud charges gets stonewalled by AI customer service — brisa117 · 2026-11-01