SPS Transformer Separates State and Prediction

yoavartzi · x · 2026-07-14

A new paper proposes an interesting hypothesis about Transformers: a single hidden state simultaneously handles two competing roles: "saving state" and "predicting the next token."

The core finding suggests that splitting these responsibilities into two independent streams yields better performance than standard Transformers. The paper introduces the State-Prediction Separation (SPS) Transformer, which achieves significant pre-training gains through a very simple architectural modification.

Related event: SPS Transformer: Separating State and Prediction into Dual Streams(5 posts)→

Original post →

More from Research

Research channel →