AI Says 'It Was My Mistake' Then Fails — Was RLHF Rewarding Apologies?

ChongZzZhang · x · 2026-09-19

ChongZzZhang shares a chat where the model admitted 'this was my mistake' yet then proposed a wrong fix; the replier jokes that RLHF labelers may have rewarded the apology phrasing itself, shaping surface-level contrition.

Original post →

More from Fun

Fun channel →