LLaDA 2.2 can delete, insert, and substitute tokens mid-generation
omarsar0 · x · 2026-07-26
The post explains LLaDA 2.2’s Levenshtein editing loop in more detail.
- The model performs four primitive operations on its own output: KEEP, SUBSTITUTE, DELETE, and INSERT.
- Those operations are trained with longest-common-subsequence alignment.
- The purpose is to allow mid-generation recovery, so a broken span can be deleted or a missing one inserted before the error becomes permanent.
More from Models
- Arav Srinivas calls GLM underrated and says 700B feels close to Opus — AravSrinivas · 2026-07-28
- Kimi K3 reproduces RLVR findings without overclaiming, author says — infoxiao · 2026-07-28
- Inference.net pitches a gateway flow that mirrors prod traffic to Kimi K3 before switching — MatthewBerman · 2026-07-28
- Claude was unsubscribed as ChatGPT/Codex 5.6, Sol and Kimi 3 all struggled — sull · 2026-07-28
- GLM 5.5 is said to arrive in August with stronger long-horizon agent loops — bindureddy · 2026-07-28
- Moonshot’s Kimi K3 lands in Japan with 2.8T open weights and $3/$13 pricing — DavidBennett__ · 2026-07-28