Baidu's ECHO: multi-token prediction reusing the last layer as a drafter

xiaohu · x · 2026-11-11

ECHO is Baidu's multi-token prediction method: the model reuses its final layer to draft several subsequent tokens, which the full model verifies in one pass. Consecutive correct drafts emit multiple tokens per step, speeding up decoding. It's one of the inference acceleration techniques behind ERNIE 5.5 Flash Preview.

Original post →

More from Models

Models channel →