Stability AI's 4Director Controls Video World Models with Rigid 3D Geometry
stabilityai · hf · 2026-10-02
Stability AI introduces 4Director, a video world model conditioned on an explicit 4D scene representation: each object is reconstructed once from the input image as a canonical mesh and moved by one prescribed rigid transformation per frame, preventing unobserved geometry from being regenerated independently. The controlled scene is rendered as a depth video, with a Motion Adapter synthesizing view-consistent appearance, illumination, and non-rigid dynamics. Training uses a new dataset of 20,774 clips with automatic rigid 3D scene annotations, and a new Identity-Gated IoU metric jointly evaluates motion adherence and identity preservation. 4Director consistently outperforms prior methods in visual quality and camera/object control.
More from Multimodal
- Image editing demo with Nano Banana — tkasasagi · 2026-10-02
- Creator: Opus 5.5 edits videos well, but forcing AI to clip without real need yields garbage — AlchainHust · 2026-10-02
- Reddit user's VEC concept car AI video shows startlingly realistic motion — Vashukanni · 2026-10-02
- Fable 5.5 rumored: webpage morphs its art style to match passing images — lxfater · 2026-10-02
- Oxford VGG Unveils SynCity 3000, Generating Globally Coherent Scene-Scale 3D Worlds — rsasaki0109 · 2026-10-02
- Omni-Embed-Mini: A 0.9B Embedder Adds Five Modalities Without Touching Text Weights — _reachsumit · 2026-10-02