ShotPlan adds learnable planning tokens for cinematic multi-shot video generation
Tele-AI · hf · 2026-07-21
What the paper proposes
ShotPlan targets cinematic video generation, where single-shot generation is not enough and coherent multi-shot structure matters.
- It adds learnable planning tokens that capture shot-level transition cues.
- These planning tokens are integrated with the original video generation tokens to control transition timestamps.
- The method uses Fractional Temporal Rotary Position Embedding (FRoPE) so transitions can be modeled at the frame level.
Reported outcome
The authors say ShotPlan outperforms existing cinematic video generation methods, with:
- more flexible shot management
- stronger inter-shot consistency
In short, the work is about making video generation behave more like a directed sequence of shots rather than a single uninterrupted clip.
More from Multimodal
- Wan2GP lands on Pinokio: 1-click AI video on 6GB GPUs — cocktailpeanut · 2026-10-27
- WanGP v18.81 adds Tencent's Hy-Nomas world model, playable on 8GB VRAM — cocktailpeanut · 2026-10-27
- Butter.video wins over skeptical creator with hundreds of tasteful timeline 'blocks' for video effects — beechinour · 2026-10-27
- AI Video Pits Brock Lesnar Against Duncan the Tall in a Toy Showdown — KloneStudios · 2026-10-27
- $50, 2-hour Kurzgesagt-style AI video reignites debate over intent in AI creation — motionbynick · 2026-10-27
- Fake BTS of a dam disaster made with Dreamina Seedance for 29 cents — Standard_Spell5873 · 2026-10-27