LLM output distributions being factored doesn't mean they can't think out of order
Aaroth · x · 2026-09-26
A technical exchange arguing that whether an output distribution is represented as a product of next-element distributions (as in LLMs) has no bearing on whether the underlying system can "think out of sequential order" — since all distributions admit such a factorization, pointing to that representation can't settle the question. The author explicitly avoids claiming human brains work like LLMs.
More from AGI Musings
- An AI model's 8-point answer on how humans can thrive in the 'Age of Miracles' — daniel_mac8 · 2026-11-11
- Podcast with X's biggest AI account: how one post made Manus famous in the West — kimmonismus · 2026-11-11
- Area Chair: reviewing AI-written reviews of AI-generated papers, the only human in the loop — murat_kocaoglu_ · 2026-11-11
- Dev Dimillian calls for content on AI-assisted work vs. pure AI slop — Dimillian · 2026-11-11
- How long until a phone-runnable model solves a Millennium Prize Problem — and Siri still lags? — paul_cal · 2026-11-11
- Superforecasters cut ASI timeline by 3 years to 2028, citing METR report — ben_j_todd · 2026-11-11