AI and Live-Action Hybrid Short Film Workflow
mrjonfinger · x · 2026-07-16
This post details the making of the short film **Encore**, where Jacob Russo blended live-action performance with AI tools to create a hybrid production pipeline. Key steps in the workflow include: - Shooting actor movements on an **iPhone** to serve as motion inputs - Translating these performances using **Luma Labs's Ray3.2** - Generating all characters and environments with **Uni-1** - Creating keyframes via **Uni-1 + GPT Image 2** - Handling music and sound design through **ElevenLabs** The main takeaway isn't about a single model, but rather a multimodal workflow connecting performance, video generation, image generation, and audio production.
More from Multimodal
- OpenArt AI demos a Video Remix tool that can transform an existing video — eyishazyer · 2026-07-21
- ElevenLabs raises ElevenMusic free usage to 400 tracks a month — lukeharries · 2026-07-21
- Google Gemini now watermarks every AI video it generates — Sure_Belt9076 · 2026-07-21
- GPT Image 2 Prompt Turns Product Shots into Surreal Reality-Bending Ads — aziz4ai · 2026-07-21
- LTX 2.3 LoRA demo changes a video’s camera angle — CQDSN · 2026-07-21
- Reddit user shares a surreal ChatGPT-generated poster — Creamy-Sundae-9991 · 2026-07-21