Runway demos real-time video model that animates your sketches as you draw

tianshi_li · x · 2026-09-16

Runway shared a first experiment built on real-time video models: a drawing app where a video model generates every frame live, animating your sketches the moment you draw them. Designer Haijun Xia amplified it as the kind of "AI magic" he loves — not delegation and instruction, but direct interaction with intelligent, dynamic materials — hinting at a new direction for generative interfaces and interaction design.

Related event: Runway demos real-time video model turning sketches into animation(2 posts)→

Original post →

More from Multimodal

Multimodal channel →