SPS Transformer Splits State and Prediction

burny_tech · x · 2026-07-15

A shared post highlighted a new Transformer study. The author argues that current Transformers use the same hidden state to simultaneously handle two competing responsibilities: maintaining state and predicting the next token.

This work proposes splitting these roles into two independent streams:

The person sharing the post noted that this direction is reminiscent of Parallel Speculative Sampling (PaSS) from years ago. They praised the work for continuing to explore the decoupling of "state representation learning" from "token prediction learning." The original post also claimed that this SPS Transformer performs better than standard Transformers.

Related event: SPS Transformer: Separating State and Prediction into Dual Streams(5 posts)→

Original post →

More from Research

Research channel →