Claude Opus 5.5 directed a full 3-minute anime music video for ~$198 in API costs
wanderingtofu · reddit · 2026-09-30
A Redditor and his wife had Claude Opus 5.5 (in Claude Code) run the entire pipeline for a 3-minute story-driven anime music video for a fictional AI singer, DIGI.
- Pipeline: Claude can't generate video/music itself, so it called Gemini for performances and ElevenLabs for the song via API, while writing and running all scripts, prompts, compositing, lip sync, editing and rendering itself
- Song first: lyrics passed a panel of reviewer personas Claude wrote (songwriter, TikTok person, skeptic, cold listener); the character design took six tries before landing on a gold line-light anime character
- Consistency: every Gemini take drew a slightly different girl, so they locked one face reference frame for all performance shots
- Lip sync as plumbing: Demucs extracts vocals, faster-whisper timestamps every word, clips get re-timed; when a take drifted too far, Claude cut to a new angle
- Self-written compositor: Python compositor rendering her face as light and lyrics streaming past; initial renders took 1 min per second of film, and Claude profiled its own code and swapped to OpenCV filters to reach 18 min per minute of video; it also caught a 25fps splice causing 2.4s of drift and rebuilt frame-exact
Cost at API rates: $114 Claude (776K output + 335M cached tokens, covered by a $200 Max plan), $81 Gemini (112 takes, 13.5 min of 720p), $1.34 Nano Banana Pro cover art, $1.46 ElevenLabs — about $198 total for a 4,512-frame, 24fps final cut with every lyric checked.
More from coding & agent
- GPT-6.1 Sol matches GPT-6 Astra at ~1/5 cost, ultrafast version targets 300 tok/s — haider1 · 2026-09-30
- Developer Has Dots Drive Its Own Computer to Run Blender and Model Itself in 3D — Dimillian · 2026-09-30
- GPT-Sol 6.1 Ships Too, as Omarsar Argues Codex-Dots Combo Unlocks New Agent Workflows — omarsar0 · 2026-09-30
- LangSmith adds Trajectories: collapsing agent sessions into readable, ordered execution paths — LangChain · 2026-09-30
- Codex Cloud announced at OpenAI DevDay, available across Plus through Enterprise tiers — testingcatalog · 2026-09-30
- Developer: Always-On AI Agents Like Muse and Grok Bot Must Be Open Source — yacineMTB · 2026-09-30