Wan-Streamer: Video as World Plus Event Stream

Wan-AI · hf · 2026-07-17

Wan-Streamer v0.3: Treating Video as "World + Event Stream"

Wan-AI released Wan-Streamer v0.3, restructuring its real-time streaming interaction model with a unified perspective: Video = Stable World + Time-Varying Event Stream. The "world" includes relatively stable contexts like environments, scenes, characters, and audio; the "event stream" covers dynamic info like scene changes, character actions, speech, and other sounds.

Training Objective Brought by This Perspective

The model is trained to: given a world and continuous input, predict how this world changes, responds, and advances in real-time. The resulting capabilities can transfer to various real-time downstream tasks.

Specific Implementation

The authors applied it to real-time full-duplex audio-video interaction:

• Input: multimodal user content
• Output: speech in language form and behavioral actions
• The overall understanding process resembles a real-time version of vision-language-action

Performance/System Metrics

• Resolution: 640x368
• Frame rate: 25 FPS
• Streaming unit: 160 ms
• Model-side response latency: approx. 200 ms
• Under a 350 ms bidirectional network budget, total interaction latency is approx. 550 ms

This indicates it's not just a pure concept demo, but emphasizes a real-time interaction stack.

Original post →

More from Multimodal

• FLUX.2 Klein Drifts Hard on Character Expressions While Free Gemini Holds Likeness — wacomlover · 2026-09-11
• Tencent Hunyuan releases AuK code and weights on GitHub with ComfyUI and fine-tuning support — aigclink · 2026-09-11
• Creator turns Bahamut vs Tiamat rivalry into an AI cinematic battle with Midjourney, GPT Image 2 and Seedance — azed_ai · 2026-09-11
• invideo launches AI agent-powered editor to automate repetitive editing tasks — azed_ai · 2026-09-11
• fable 5.1 recreates The Starry Night with 256,157 JavaScript brush strokes — cedric_chee · 2026-09-11
• GPT-6 Astra + Hyper3D Rodin MCP Generates 3D Assets in One Agent Flow — ahuja_priyank · 2026-09-11

Multimodal channel →