Chat-based LLMs replicate the mechanisms of a psychic's con, essay argues
jalev · hn · 2026-09-20
This essay argues that chat-based LLMs work much like a mentalist's cold reading: vague, generalized statements that get the user to fill in meaning, feedback loops that 'refine' output based on reactions, and fluency that masks missing information. The author maps classic con techniques—Barnum phrasing, sycophancy—to LLM dialogue behavior and warns against mistaking agreeable output for genuine understanding.
More from AGI Musings
- Business strategy debate: hide the AI behind humans, not humans behind AI — annetgriffin · 2026-11-12
- If superhuman AI researchers are imminent, will capability problems be easier than safety ones? — ronbodkin · 2026-11-12
- "AI is a terrible teacher": viral pushback against personalized AI tutoring hype — RachelVT42 · 2026-11-12
- TissueMicroscopyBench: 49 evals to test AI agents on biological microscopy — kenbwork · 2026-11-12
- OpenAI, Anthropic and DeepMind job posts signal PMs must write evals and code — aakashgupta · 2026-11-12
- Architecture study sparks monitoring concerns over a multi-hop planning spike — ChowdhuryNeil · 2026-11-12