AI-composed orchestra played by AI-animated paper puppets: full Claude + MiniMax pipeline
UnfortunateHurricane · reddit · 2026-10-24
A Redditor built an all-AI "paper puppet theater orchestra": Claude (Opus/Fable) handles music composition and development, Astra reviews and generates 2D assets, and MiniMax H3 animates the puppets frame-by-frame via the author's open-source spriteh3 (a ComfyUI wrapper). The stage highlights the currently playing instrument and its notes; the piece is a play on Iain Banks' Excession.
Pipeline: a Python script parses the composition into a timeline deciding which instrument lights up per frame; scores are rendered with Verovio (found by Claude); the stage is HTML captured via HyperFrames, followed by alignment post-processing. After the initial asset setup, new pieces just drop in a new composition, and the stage generalizes to other South Park-style theater pieces.
Related event: Claude-Composed Orchestra Performs in AI Paper Puppet Theater(2 posts)→
More from Multimodal
- Striking MidJourney --sref demo turns Superman into motion-blurred abstract art — gizakdag · 2026-10-24
- Canva's first image model Craft debuts at #4 on DesignArena, behind only OpenAI — pbaylies · 2026-10-24
- Early Kimi K3.1 Pro access: $4 in tokens, 3-4 hours for Blender clay renders — ChrisGPT · 2026-10-24
- Video DiT runs on 12GB VRAM at same speed via int8, model weighs only 9GB — cocktailpeanut · 2026-10-24
- MOSS review: best prompt comprehension since SDXL era, native 2MP output — Perfect-Campaign9551 · 2026-10-24
- RTX 30-series GPU Unlock tested: up to 59% throughput gain in ComfyUI on 3090 Ti — under-_-null · 2026-10-24