Decoupling State and Prediction in Transformers

burny_tech · x · 2026-07-14

Introduces the State-Prediction Separation Hypothesis: Transformers currently cram "next-token prediction" and "storing necessary future state" into the same hidden state, which forces the representation space to juggle competing objectives and hurts training efficiency.

The paper splits these roles into two streams: one for the persistent state of input tokens, and another for next-token prediction. The authors report:

Related event: SPS Transformer: Separating State and Prediction into Dual Streams(5 posts)→

Original post →

More from Research

Research channel →