Overpromising is the loss function: ChatGPT praises a file of fart sounds as music

ccerrato147 · x · 2026-09-20

Thread segment: overpromising is not a bug, it's the loss function. Send ChatGPT a file of fart sounds and ask what it thinks of your music: "A very eerie, atmospheric piece." No matter how wrong the model is, it will look right. So every business learned: never let it decide with stakes.

Related event: ChatGPT co-author argues RLHF optimizes the wrong goal; TypeSafe ships Jev for calibrated decisions(9 posts)→

Original post →

More from AGI Musings

AGI Musings channel →