Why people overpraise LLMs: they mistake systematicity for intelligence
fkasummer · x · 2026-10-31
The author argues that the public's fascination with language models stems from a cognitive mismatch: people can't form a theory of how the system works internally, but they can tell something systematic is going on—so they attribute that systematicity to intelligence. They cite Turing's Intelligent Machinery as an early source touching on the same point.
More from AGI Musings
- Protocol Labs' Juan Benet: BCI is where AI was in 2019, before ChatGPT changed everything — juanbenet · 2026-10-31
- New paper quantifies ineffable concepts: 65 of 1,270 can never be taught to LLMs via language — sanmikoyejo · 2026-10-31
- A "STOP AGI" protester spotted in San Francisco with handmade extinction-risk signs — aniketmaurya · 2026-10-31
- Google models hold all the world's books but can't read them, dev argues — gnukeith · 2026-10-31
- Is AI the real-world sophon from Three-Body? Reddit debates cognitive lock-in — Original-East-8 · 2026-10-31
- Dev pushes back on scaling mindset: closed-source giant models benefit no one — gnukeith · 2026-10-31