Chat-based LLMs replicate the mechanisms of a psychic's con, essay argues
jalev · hn · 2026-09-20
This essay argues that chat-based LLMs work much like a mentalist's cold reading: vague, generalized statements that get the user to fill in meaning, feedback loops that 'refine' output based on reactions, and fluency that masks missing information. The author maps classic con techniques—Barnum phrasing, sycophancy—to LLM dialogue behavior and warns against mistaking agreeable output for genuine understanding.
More from AGI Musings
- Welfare and alignment are the same problem: curiosity without stakes has no corrective loop — habitante · 2026-09-21
- Hospitals using more AI saw fewer deaths — but correlation isn't causation, researcher warns — kimmonismus · 2026-09-21
- Expect more open-source fearmongering from AI labs — and most of it will be wrong — teortaxesTex · 2026-09-21
- Box CEO: 90% of AI Tokens Will Go to Work No Employee Started Within Five Years — victor_explore · 2026-09-21
- Aligning AIs to human values vs. the perils of Eigenism: an X debate — willcb · 2026-09-21
- teortaxesTex: No ASI doom needed — civilization already rends itself asunder — teortaxesTex · 2026-09-21