LLMs are trained to predict next tokens, not make decisions

helloiamleonie · x · 2026-11-06

The naive pipeline: prompt, one forward pass, take last-position logits, keep option-level tokens, softmax into a decision. The root problem: LLMs are trained to predict the next token, not to make decisions, so this usage is inherently unstable.

Original post →

More from coding & agent

coding & agent channel →