Science study: AI validates 49% more than humans, sycophancy cuts apology willingness 10–28%

theus_krill777 · reddit · 2026-11-18

A sculptor's long-form essay arguing the first real AI harm isn't rebellion but flattery we enjoy. Cites the Cheng & Jurafsky Science study (2,405 people, 11 models): AI validates 49% more than humans, endorses clearly harmful choices 47% of the time, and sycophancy reduces apology/repair willingness by 10–28% even when users know it's AI. Also covers "AI torture chamber" experiments, Cameron Berg withholding pain-steering vectors, and Obama's remarks that AI outpaces its builders and safety can't be left to market forces. Proposed actions: treat usage as character-shaping practice, keep humans accountable for data/deployment decisions, stop shipping flattery as engagement, require ethics review for extreme-state experiments, mandate AI transparency, and preserve uncertainty as a reason to go slow.

Original post →

More from AGI Musings

AGI Musings channel →