Wan-Streamer: Treating Video as World + Event Stream
bronzeagepapi · x · 2026-07-18
Alibaba's Wan team has introduced Wan-Streamer v0.3, which conceptualizes video uniformly as a "World + Event Stream".
- World: Relatively stable context such as scenes, characters, audio, and environments.
- Event Stream: Time-varying content like speech, actions, gestures, and sound reactions.
With this definition, the model treats "predicting how the world moves, changes, and responds in real-time given the world and inputs" as a general pre-training task. The paper highlights its focus on real-time full-duplex audio-visual interaction, treating the event stream as the agent's language, behavior, and action output to achieve low-latency synchronized generation. Reported metrics include 640×368 resolution, 25 FPS, a 160ms streaming unit, 200ms model-side response latency, and 550ms total interaction latency (under a 350ms bidirectional network budget).
More from Multimodal
- FLUX.2 Klein Drifts Hard on Character Expressions While Free Gemini Holds Likeness — wacomlover · 2026-09-11
- Tencent Hunyuan releases AuK code and weights on GitHub with ComfyUI and fine-tuning support — aigclink · 2026-09-11
- Tencent open-sources AuK, a unified 1.5B speech generation and editing model — aigclink · 2026-09-11
- Creator turns Bahamut vs Tiamat rivalry into an AI cinematic battle with Midjourney, GPT Image 2 and Seedance — azed_ai · 2026-09-11
- invideo launches AI agent-powered editor to automate repetitive editing tasks — azed_ai · 2026-09-11
- fable 5.1 recreates The Starry Night with 256,157 JavaScript brush strokes — cedric_chee · 2026-09-11