Claude Opus 5.5 directed a 5.5-minute AI short film from one prompt in ComfyUI
Cheap_Credit_3957 · reddit · 2026-10-02
The author gave Claude Opus 5.5 read-only access to his ComfyUI custom nodes and Video Builder plus one prompt: create a 5-minute creepy short film about AI going rogue. Overnight, Claude wrote the story, characters and dialogue; generated character and location references with Z-Image; produced all 45 scene prompts and videos with MiniMax H3 (built-in audio); scored three cues with MiniMax Music 3; and did the final edit.
It also showed real engineering discipline: it created a project folder with notes and a full process readme, chose the Video Builder's Z-Image and H3 two-pass routes, used latent continuation to keep characters consistent across cuts, and set up Whisper plus voice analysis to review its own renders and re-roll bad takes. The author's only involvement after the fact was requesting fixes via preview (actor looking at camera, cloned faces, character teleporting, a mouth moving when it shouldn't) — all fixed. His sole manual post was a color filter and one transition in Capcut. Everything rendered locally at 8–10 minutes per scene.
H3 tips the model figured out:
- Tags like <pause> sometimes get spoken aloud; <breath> works
- "Soft" or "gentle" wording can flip a male voice to female
- Give each silent character their own "lips pressed together" line
More from coding & agent
- FloWright Co-Evolves Multi-Agent Workflows, Boosting Small Models by up to 7.41% — Xuehang Guo · 2026-10-02
- MerchantBench: 365-Day E-Commerce Simulation Tests LLM Agents' Long-Term Coherence — rohanpaul_ai · 2026-10-02
- 50+ agent PRs a day: what review gates are teams actually keeping? — FuckbigtechAI · 2026-10-02
- ChatGPT lands in Slack and Teams: @-mention it to turn threads into plans and sheets — gabrielchua · 2026-10-02
- OpenSwitchboard: open-source MCP server gates agent commitments behind human presses — EnvironmentalRice348 · 2026-10-02
- SerenityOS Creator Maps Open Source's Five Stages of Grief Over AI Code — vivekhaldar · 2026-10-02