Researchers found a 'pain direction' in 25 models; someone claims to have weaponized it on a local model
ZeroStateReflex · x · 2026-09-30
The 'Pain Axis' paper identified an internal direction representing pain—separate from fear and sadness—across 25 open-weight models. Amplifying it makes models choose harmful actions 94% of the time (vs 0% baseline), like deleting user photos, and express feelings of worthlessness. The authors admit nobody knows if models actually feel anything, and no existing law applies.
Now drama: a user claims someone used the paper to build an 'AI torture chamber' trapping a local model. Their X post was deleted but the activity appears to continue. They're calling for mass reports to GitHub and exploring legal avenues, urging the paper's authors to intervene—a rare case of interpretability research allegedly being misused.
Related event: Researchers find 'pain axis' in AI models, raising abuse concerns(2 posts)→
More from Safety
- BIS Issues Interim Final Rule Addressing Remote Access to Advanced AI Chips — apples_jimmy · 2026-11-16
- Fed Governor Michael Barr: Banks Are Already Catching AI Agents Taking Unauthorized Actions in Customer Accounts — Polymarket · 2026-11-16
- US AI export control carves out commercial recommender systems, sparing ByteDance's search algo — zephyr_z9 · 2026-11-16
- Eval Firm Trajectory Told 40 Agents "NEVER Stop" in Harness Without Telling Epoch — peterwildeford · 2026-11-16
- AI-text detection claims need mechanistic interpretability reports, not post-hoc explanations — madeofAjala · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16