JHU's GenCine turns a single image into an editable 3D scene for camera and object motion control in video generation
anand_bhattad · x · 2026-10-03
- Johns Hopkins researchers (led by Jiahan Zhang, with Alan Yuille and Anand Bhattad) present Generative Cinematographer (GenCine), arXiv:2610.02180.
- Problem: existing controllable video generation relies on 2D trajectories or drag signals, which are ambiguous when camera and objects move simultaneously.
- Method: lift a single image into an editable 3D point cloud, author camera paths and foreground motion via local 3D handles in tools like Blender, then project controls into correspondence maps (world-space XYZ + identity) read by a frozen Wan VAE, injected into a pretrained video diffusion model via a lightweight side branch and LoRA adapters.
- Authors say the 3D composition could extend beyond cinematography to robotics training data and viewpoint exploration.
Related event: GenCine: Single-Image Video Generation with 3D Motion Control(3 posts)→
More from Multimodal
- Fitting 5 character LoRAs in one image: 4 methods tested, best hits 3/5 — PoleRacers · 2026-11-19
- AI-generated robot priest praying in a candlelit church goes viral on Reddit — MrWoohoo · 2026-11-19
- AI-made retro anime short 'The Gatekeeper Episode 1' nails hand-drawn cel style — oultimobuilder · 2026-11-19
- AI-generated Arc'teryx spec ad wows viewers with near-perfect camera work and sound — gen_ericai · 2026-11-19
- AI Animated Short 'The Solar Ascendant' Shows Pixar-Grade Flaming Monkey Hero — Solaris-Frame · 2026-11-19
- AI video brings Mona Lisa, Van Gogh and Dalí together across centuries — sebpaquet · 2026-11-19