LLM 'consciousness' comes from conversational output, not reasoning power
dansitu · x · 2026-10-01
Arguing against claims that LLMs are conscious, the author notes people believe it only because LLMs are trained to output conversational dialog. You could build equally powerful reasoning models that emit obscure vectors of weather predictions — and nobody claims those can feel. The intuition of consciousness stems from the conversational surface, not the underlying capability.
Related event: Debate Flares Over Whether LLMs Are Conscious(4 posts)→
More from AGI Musings
- Raw intelligence is not a stock of tokens: the habit of internalizing structure — yunta_tsai · 2026-10-02
- Why AI progress confuses everyone: daily coding-model users can't explain it to others — paulnovosad · 2026-10-02
- Ben Todd: EA was always a mix of weird and sensible ideas, not a slide into weirdness — ben_j_todd · 2026-10-02
- Observer: personal agents are automating away exactly the tasks people enjoy most — signulll · 2026-10-02
- MIT report flags AI access gap as the new digital divide in education — LearnWithBishal · 2026-10-02
- Dev debunks 'AI-generated content is boring' claim: just underspecify — flowersslop · 2026-10-02