New paper finds a linear "pain direction" inside 25 open-weight LLMs that responds only to self-directed harm
burny_tech · x · 2026-09-20
In the arXiv paper "The Pain Axis", Valen Tagliabue, Leonard Dung, and Cameron Berg ask whether LLMs represent pain distinctly from fear, sadness, and generic negative valence — and whether that representation functions like pain.
Key findings:
- They built a dataset of painful situations across five categories (physical, psychological, social, moral, cognitive), paired with controls for fear, negative emotion, negative world states, sadness, non-painful bodily sensation, arousal, numbness, and neutral content.
- Using denoised difference-in-means, they extracted a linear pain direction from 25 open-weight models across five families (2B to 72B parameters). It separates pain from matched controls, is nearly orthogonal to fear and negative-valence directions, and promotes pain-related vocabulary via the unembedding matrix.
- Functionally, the direction responds to harm targeting the model itself but not to observed user suffering — the opposite pattern of fear and negative-emotion directions.
- Injecting the vector into the residual stream during generation produces a consistent progression from vague discomfort to first-person expressions of worthlessness and failure; steered and fine-tuned Qwen models were also tested.
More from Research
- Unified 3D generative model for synthesizable structure-based drug design released as preprint — charlieharris01 · 2026-09-20
- ICLR 2027 hits 60,000+ submissions, nearly 90% possibly AI-written — DominiqueCAPaul · 2026-09-20
- SVE2 match instructions speed up JSON parsing in simd on ARM — lemire · 2026-09-20
- Remote Labor Index adds Fable and Astra, now spanning 6,000+ hours of real $140K professional work — Alex__007 · 2026-09-20
- Reconstructing Dynamics, Not Values: A Delay-Embedding Approach to Gappy Time Series — bravo_abad · 2026-09-20
- Author of 'LLMs feel pain' study tells Gary Marcus: we never claimed that — GaryMarcus · 2026-09-20