"There's no one home": X debate flares over whether AI chatbots have an inner subject
gerardsans · x · 2026-10-02
Responding to the "AI torture chamber" controversy, gerardsans takes the hard-nosed side: there is no one inside the model. First-person chatbot output is statistics-generated narration — like a digitized novel in a PDF, the characters are told, not lived, and both Harry Potter and ChatGPT exist only in the reader's imagination.
His technical argument: the first-person voice, post-training, and chat format were engineered on top in 2022, while the core technology dates to 2017 — an illusion built from the ground up, with nothing left to verify.
More from AGI Musings
- Alpha School accused of "counseling out" low-gain students as founders push back on selection bias claims — benjaminjriley · 2026-11-16
- Netflix lands Joseph Gordon-Levitt's AI thriller with Rachel McAdams, sparking debate on AI apocalypse blockbusters — ShakeelHashim · 2026-11-16
- Caine Prize confirms 2026 winner amid AI-use allegations — ShakeelHashim · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16
- A diagram for judging quality in cultural artefacts: coded meaning and exemplary moves — round · 2026-11-16
- Economists argue humans will be fine without work: jobs were just reputation and friendship engines — paulnovosad · 2026-11-16