arXiv paper reuses KV cache via M-RoPE offset for editable video context, cutting prefill tokens 30%

RulinShao · x · 2026-11-23

The paper "Editable Video Context: Mid-Context KV-Cache Reuse for Context-Managing Video LLMs" extends Context Language Models and Suffix Cache Reuse to video LLMs:

Code, raw logs and reproduction scripts are released. CLM author Rulin Shao highlighted the work, suggesting RL might teach video models where to look and that native video cache reuse in vLLM/SGLang could convert the savings into real speedups.

Related event: KV-Cache Reuse Brings Mid-Context Editing to Video LLMs(2 posts)→

Original post →

More from Infra

Infra channel →