Register Tokens Let Diffusion LLMs Keep Reasoning After Clearing Context

Researchers propose register tokens for diffusion LLMs, letting models write and read dedicated tokens so reasoning continues even after clearing generated history, with up to 8.5-point math gains.

2026-09-17 ~ 2026-09-17 · 2 related posts