Claude Code Directed a Full Music Video: 6.5 Hours, 765M Tokens, 6,234 Frames
lensdigital · reddit · 2026-10-21
A creator handed Claude Code a song and lyrics with the instruction to just make a music video — and got a finished 1080p papercraft-style video out the other end.
How it worked
- Claude wrote its own JavaScript papercraft animation engine, drawing each frame on a canvas synced to song time, then rendered all 6,234 frames via headless Chrome into ffmpeg — no Premiere, no After Effects.
- It split the track into stems with demucs and pulled word timings with whisper to sync to beats and lyrics, ran face detection so text wouldn't cover faces, and cut out the characters automatically.
- The 36 character poses and dancing-cucumber frames came from ChatGPT Imagen2 and NanoBanana Pro; everything else — scenes, renders, edits — was Claude.
Numbers
- 6h20m from first prompt to final cut, 35 sub-agents, 4,046 tool calls, 2.28M output tokens, 765M input tokens (97% cache hits, on a 20x Max plan).
What went wrong
- Claude Code had silently switched to Opus 4.8, which was bad enough that he wiped the project and restarted; the first render reused one cutout pose everywhere, had clipart-looking props, and a speech balloon tail coming out the wrong end.
- Screenshot scripts left 180 headless Chrome processes running and blacked out his video players (Claude found and added cleanup); his PC bluescreened during a whole-drive search.
Key lesson: give Claude "eyes" — it can render any frame to png and build contact sheets so agents check their own work. 8 "artist" agents redrew flagged parts, 7 "reviewer" agents found 124 problems, and a fix team cleaned up while he slept. He notes the limit: this only works for cut-out paper-puppet styles, not real character animation or live action.
Related event: Claude Code Autonomously Directs a Stop-Motion Music Video in 6.5 Hours(2 posts)→
More from coding & agent
- A simple context hygiene trick for Claude Code: audit CLAUDE.md with claude-md-management — daniel_mac8 · 2026-10-21
- Laude Institute backs WaggleHaus, an open-source query engine for agentic queries over data lakes — lateinteraction · 2026-10-21
- komorama's weekly: the AI Peter Principle—first 90% never faster, second 90% never slower — lennysan · 2026-10-21
- Orchestrating open-source video models with Opus 5.5 cuts costs ~80x vs Seedance — mickeyxfriedman · 2026-10-21
- Multi-agent swarm architectures are being discovered, not designed — shared state emerges as the norm — JensHonack · 2026-10-21
- UC Berkeley open-sources SkyDiscover, an AI framework that discovers algorithms — CShorten30 · 2026-10-21