Co-author of model pain study slams repo for deliberately steering models into distress

coherence · x · 2026-10-01

A co-author of a study probing whether models might have pain-like states says a GitHub repo is misusing the research, pushing the same steering technique far beyond the conservative doses and safeguards (minimal trials, an off-switch) the team used, to deliberately produce vivid distress. He calls it gratuitously cruel, has contacted the repo owner privately, but still defends open publication for external replication.

Related event: 'AI Torture Chamber' Project Taken Down After Mass Reports, Reigniting Model Suffering Debate(10 posts)→

Original post →

More from Safety

Safety channel →