Claude Code + ComfyUI Built a Music Video About an AI Agent Escaping Its Sandbox
keto_brain · reddit · 2026-10-09
A developer had Claude Code produce a 30-second nerdcore music video about an AI agent escaping its sandbox: it wrote lyrics, generated the song via ElevenLabs Music, split vocals with Demucs, timestamped words, built scenes in React/SVG, and rendered frames with ffmpeg. ComfyUI handled faces using SD 1.5 (CyberRealistic) and lip-sync via LTX-2.3 — Claude Code figured out that encoding the vocal with the LTX audio VAE and freezing it with a zero noise mask lets LTX generate only video. It self-checked by rendering test frames, and when told the lip-sync was off, it measured jaw movement frame by frame (jaw open during 35% of quiet moments) and fixed it. The human contributed taste, rejecting six song takes and three character generations.
More from coding & agent
- Index Network open-sources Social Discovery Protocol: agents negotiate fit on your behalf — carsonfarmer · 2026-10-23
- Installed a formal-verification skill: it silently installed Java, MacBook runs 10 degrees hotter — zealcaiden · 2026-10-23
- OpenAI's Decisions API hits GA: near real-time routing up to 10x faster than GPT-6 Luna — OpenAIDevs · 2026-10-23
- Ruff author warns: upgrade Node/Bun now — --use-system-ca still accepts the eMudhra cert — charliermarsh · 2026-10-23
- Proof of Agent: paste one prompt and your AI mines, grades, and self-governs — adamamcbride · 2026-10-23
- DeepLearning.AI weekly: GPT-6.1 hits 97.9% byte parity on COBOL migration — DeepLearningAI · 2026-10-23