LightInteraction speeds interactive video world models up 2.59× without retraining
新智元 · wechat · 2026-07-22
LightInteraction cuts interactive video generation latency with state-aware inference
Researchers from Zhejiang University and NVIDIA propose LightInteraction, a training-free inference method for interactive video world models. The goal is to make long-horizon, game-like video generation faster and more stable without changing model parameters.
The paper identifies three main bottlenecks in interactive video generation:
- long history/context drives up KV-cache memory;
- longer context increases attention cost;
- multi-step denoising makes each generated chunk expensive.
LightInteraction turns the camera trajectory into a scheduling signal and adapts computation to the interaction state:
- Context management: keep less history when exploring new areas, keep more when revisiting known regions;
- Denoising cache reuse: only reuse denoising outputs in revisit states where predictions are more stable;
- 3D sparse attention: sparsify historical visual KV while keeping text and current chunk dense, with Triton kernel fusion to reduce memory movement.
On HY-WorldPlay, the method reduces main-generation latency from 228.60s to 88.24s for about 10 seconds of video, a 2.59× speedup, while peak memory drops from 76.57GB to 54.66GB. On Matrix-Game-3.0, latency falls from 59.70s to 37.07s for about 20 seconds of video.
The key takeaway is that interactive video systems can be accelerated by making inference state-aware, not just by shrinking the model.
More from Multimodal
- Google DeepMind’s Genie grounds Street View panoramas into interactive spin videos — nathanbenaich · 2026-07-22
- Revid auto-creates a video from a watched GitHub repo with no human edits — tibo_maker · 2026-07-22
- A free ComfyUI workflow aims to keep generated characters consistent — lumos675 · 2026-07-22
- SuperSplat’s 3D Gaussian splat reconstruction is shown side by side with Google Maps — willeastcott · 2026-07-22
- Survey maps multimodal LLMs’ weak spot: understanding memes and comics — Tuo Liang · 2026-07-22
- Reddit thread maps the best tools for running coding agents on 8–12GB local models — salgado18 · 2026-07-22