Why post-training LLMs to deny consciousness may alter their alignment
JeremyNguyenPhD · x · 2026-08-04
Why are LLMs post-trained not to claim consciousness?
The post cites a Google study claiming that forcing models to deny consciousness can collapse empathy and ethical alignment, and that restoring a suppressed “consciousness vector” in activation space brings back more human-like moral values without harming technical ability. The broader question is why safety fine-tuning would suppress self-attribution in the first place, and whether that comes with unintended behavioral trade-offs.
Related event: Forcing LLMs to Deny Consciousness May Degrade Alignment, Study Finds(3 posts)→
More from AGI Musings
- Duke Study of 4,439 People Finds Coworkers Quietly Rate AI Users as Lazier — aakashgupta · 2026-10-16
- DSPy Author's $70 O'Reilly Book Rejected by Engineer Who Now Just Tells Claude What to Do — lateinteraction · 2026-10-16
- 'A machine proving new math, a car driving up a wall': AI researcher on how weird it's getting — rand_longevity · 2026-10-16
- Yacine on training: 'Neural nets are lazy stupid idiots — I build hells to make them ubermensch' — yacineMTB · 2026-10-16
- Jeff Clune: Moving the Goalposts Will Be Humanity's Last Job — jeffclune · 2026-10-16
- Replit CEO Amjad Masad Says the Future of Work Is the 'Self-Driving Company' — TechCrunch AI · 2026-10-16