PIPO: Bidirectional Acceleration Architecture for Long Reasoning

小红书技术REDtech · wechat · 2026-07-10

Xiaohongshu's large model infrastructure team proposed the PIPO (Pair-In, Pair-Out) architecture to improve the efficiency of long-chain reasoning. It compresses two tokens into one latent on the input side, and expands multiple tokens at once via an MTP head on the output side, simultaneously alleviating the bottlenecks of long-context prefill and token-by-token decoding.

Original post →

More from Infra

Infra channel →