Researcher Calls "LLMs Are Just Next-Token Predictors" a Contentless Claim

Aaroth pushes back on the claim that LLMs are "just next-token predictors," calling it technically contentless. He notes that the once-interesting question of whether next-token representations pose hard computational hurdles was resolved years ago.

2026-09-25 ~ 2026-09-25 · 3 related posts

• 'Next-token predictor' is a contentless way to describe LLMs — Aaroth · 2026-09-25
• The decade-old worry that next-token representation would hinder learning turned out unfounded — Aaroth · 2026-09-25
• Why 'LLMs are just next-token predictors' is a contentless argument — Aaroth · 2026-09-25