'Just Next-Word Prediction' Massively Underrates AI: Predicting Proof-Level Tokens No Human Can Match

jeremiecharris · x · 2026-11-19

Jeremie Harris endorses an argument that 'it just predicts the next word' massively undervalues how hard that task really is.

The quoted argument: predicting the next word in a mostly finished sentence is easy, but predicting every next word in a math proof well enough to solve Navier-Stokes — as GPT 6.2 Astra just did — is something no human could do. The MMA analogy: a fighter who predicts your next strike would go undefeated in the UFC even with below-average strength and speed.

Harris adds that while academic, it's a good intuition pump for why AI can go further than many think — even filling in 'To prevent China from stealing America's best models, the U.S. should ' is 'just autocomplete'.

Original post →

More from AGI Musings

AGI Musings channel →