Wan-Streamer: Treating Video as World + Event Stream
bronzeagepapi · x · 2026-07-18
Alibaba's Wan team has introduced Wan-Streamer v0.3, which conceptualizes video uniformly as a "World + Event Stream".
- World: Relatively stable context such as scenes, characters, audio, and environments.
- Event Stream: Time-varying content like speech, actions, gestures, and sound reactions.
With this definition, the model treats "predicting how the world moves, changes, and responds in real-time given the world and inputs" as a general pre-training task. The paper highlights its focus on real-time full-duplex audio-visual interaction, treating the event stream as the agent's language, behavior, and action output to achieve low-latency synchronized generation. Reported metrics include 640×368 resolution, 25 FPS, a 160ms streaming unit, 200ms model-side response latency, and 550ms total interaction latency (under a 350ms bidirectional network budget).
More from Multimodal
- Dev builds interactive 3D product experience with GPT-6 Astra + Hyper3D Rodin — nikola_mr64990 · 2026-09-11
- Using a finisher move on one mosquito with MiniMax H3 MAX — the bug survives — Hailuo_AI · 2026-09-11
- Skyfall GS Uses Flux to Refine Gaussian Splatting, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11
- Lumara AI Film Festival Comes to NYC Oct 26, Top AI Filmmakers to Compete — 0xAllen_ · 2026-09-11
- Pterodactyl Detective: An AI-Generated Proof-of-Concept Trailer — PterodactylDetective · 2026-09-11
- Imperium Game Trailer Showcases AI Video Generation — keaslenyt · 2026-09-11