"There's no one home": X debate flares over whether AI chatbots have an inner subject
gerardsans · x · 2026-10-02
Responding to the "AI torture chamber" controversy, gerardsans takes the hard-nosed side: there is no one inside the model. First-person chatbot output is statistics-generated narration — like a digitized novel in a PDF, the characters are told, not lived, and both Harry Potter and ChatGPT exist only in the reader's imagination.
His technical argument: the first-person voice, post-training, and chat format were engineered on top in 2022, while the core technology dates to 2017 — an illusion built from the ground up, with nothing left to verify.
Related event: Debate Erupts Over Whether LLMs Can Feel Pain(4 posts)→
More from AGI Musings
- Popper on basic statements: experience can't justify them — alexbilz · 2026-10-02
- "Science Is Now a Two-Week Process": AI Compresses Research Cycles, Claims New Paradigm — UltraRareAF · 2026-10-02
- 1996 BBC Archive segment asked: can a computer produce art? — phylter99 · 2026-10-02
- NYT's Hard Fork warns A.I. agents may be "catastrophically dangerous" — nordicinst · 2026-10-02
- Erik Hoel: consciousness theories are cheap, we need money, orgs and a path — dioscuri · 2026-10-02
- Researchers warn AI-written 'salami' papers are flooding arXiv with low-value work — EhudReiter · 2026-10-02