Alibaba DAMO unveils WorldAttention for efficient interactive video world models
Alibaba-DAMO-Academy · hf · 2026-09-30
Alibaba DAMO Academy 发布 WorldAttention,一套面向文本条件交互式视频世界模型的高效注意力架构,解决长时程生成中的历史上下文与显存瓶颈问题。核心设计:
- Hybrid Sparse Attention (HSA):线性全局注意力 + 头自适应稀疏注意力,替代传统滑窗机制造成的上下文丢失。
- Hierarchical KV Cache (HKV):将历史 KV 对按语义索引组织到多级存储页中,细粒度检索并控制 GPU 驻留,避免 KV cache 线性增长导致显存饱和。
- 配套定制 kernel 将理论效率转化为实际性能。
在 VBench-Long 和 InterVBench 上全面超越此前 SOTA,主体一致性分别达 0.9472 和 0.9668。该架构瞄准具身智能与基于仿真的规划所需的低延迟、长时长生成场景。
More from Multimodal
- Testing Qwen Image 2.1 and Minimax H3 on anime-to-photo conversion and film photo restoration — Ant_6431 · 2026-11-16
- Second take of a 'Cubee run' video generated with Minimax H3 — JahJedi · 2026-11-16
- Non-artist builds 14-chapter hand-painted storybook game with Fable 5.2 in 4 hours — jradoff · 2026-11-16
- Subject LoRAs on Minimax H3 Image learn poor likenesses while identical datasets excel on Qwen 2.1 — Ad_Organic · 2026-11-16
- Seedance-generated anime train scene stuns Reddit with cinematic quality — Ok-Solution-7889 · 2026-11-16
- AI-generated 'Men in Black' reimagined in 1977 goes viral — techhalla · 2026-11-16