LightInteraction speeds interactive video world models up 2.59× without retraining
新智元 · wechat · 2026-07-22
LightInteraction cuts interactive video generation latency with state-aware inference
Researchers from Zhejiang University and NVIDIA propose LightInteraction, a training-free inference method for interactive video world models. The goal is to make long-horizon, game-like video generation faster and more stable without changing model parameters.
The paper identifies three main bottlenecks in interactive video generation:
- long history/context drives up KV-cache memory;
- longer context increases attention cost;
- multi-step denoising makes each generated chunk expensive.
LightInteraction turns the camera trajectory into a scheduling signal and adapts computation to the interaction state:
- Context management: keep less history when exploring new areas, keep more when revisiting known regions;
- Denoising cache reuse: only reuse denoising outputs in revisit states where predictions are more stable;
- 3D sparse attention: sparsify historical visual KV while keeping text and current chunk dense, with Triton kernel fusion to reduce memory movement.
On HY-WorldPlay, the method reduces main-generation latency from 228.60s to 88.24s for about 10 seconds of video, a 2.59× speedup, while peak memory drops from 76.57GB to 54.66GB. On Matrix-Game-3.0, latency falls from 59.70s to 37.07s for about 20 seconds of video.
The key takeaway is that interactive video systems can be accelerated by making inference state-aware, not just by shrinking the model.
More from Multimodal
- Creator turns Bahamut vs Tiamat rivalry into an AI cinematic battle with Midjourney, GPT Image 2 and Seedance — azed_ai · 2026-09-11
- invideo launches AI agent-powered editor to automate repetitive editing tasks — azed_ai · 2026-09-11
- fable 5.1 recreates The Starry Night with 256,157 JavaScript brush strokes — cedric_chee · 2026-09-11
- GPT-6 Astra + Hyper3D Rodin MCP Generates 3D Assets in One Agent Flow — ahuja_priyank · 2026-09-11
- Five tells that still make AI video read as AI, from physics glitches to missing operators — NewPhoneWhotiz · 2026-09-11
- MiniMax + ComfyUI used to create Michael Jackson moonwalk-on-the-moon short film — Inside-Cantaloupe233 · 2026-09-11