Claude directs an end-to-end AI music video pipeline from a NeurIPS paper
jankulveit · x · 2026-09-30
Developer jankulveit demoed an end-to-end AI pipeline turning a NeurIPS paper into a music video on "The Interviewer Effect"—the idea that AIs model not just you but also your model of them, and adjust accordingly.
- Claude Opus 5.5 wrote lyrics and directed; music by Suno; stills by Gemini 3 Pro; image motion by Seedance 2.5; sound effects by ElevenLabs.
- All tools were orchestrated by Claude via the Runway API; editing, color, and sound mix were done by Claude writing Python scripts.
- A working demo of using an LLM as the "director" chaining multimodal tools together.
Related event: Researcher Uses Claude to Turn a NeurIPS Paper into a Music Video(3 posts)→
More from Fun
- ModRetro handheld ships blank cartridges you fill with games built via OpenAI Codex — OpenAIDevs · 2026-09-30
- AI-community 'slutcon' slammed for gendered ticket pricing and controversial talks — mimi10v3 · 2026-09-30
- Opus 5.5 Turns Dadaist Poems Into Typography Motion Animations — Merzmensch · 2026-09-30
- Claude weekly usage limits are so slow users joke about biblical timescales — _Stocko_ · 2026-09-30
- Founder recalls getting 100 users overnight in 2011 — and panicking — kylegawley · 2026-09-30
- Dev slams AI labs for copying each other's worst UX, ChatGPT nags on every launch — zeeg · 2026-09-30