The Curious Resistance to Next Token Prediction

willdepue · x · 2026-07-12

The author jokes that many people seem fiercely opposed to "next token prediction," instinctively recoiling at the idea that models might just be Transformers predicting the next word.

He interprets this reaction as either people genuinely believing their intuition can see inside the model, or simply feeling uncomfortable with the divine being oversimplified.

Original post →

More from Fun

Fun channel →