LLM-composed orchestra piece visualized with AI-animated paper puppets: the full pipeline
chrisBhappy · reddit · 2026-10-24
The author used LLM-driven music composition and visualized each instrument in real time as a paper-puppet theater, highlighting the currently playing instrument and notes.
The pipeline:
- Composition and development were done mainly with Claude (Fable and Opus); Astra served as reviewer and generated 2D assets (props and character first frames) via GPT-Image.
- Animation used MiniMax H3 through the author's open-source sprite tool (github.com/fmmix/spriteh3), requiring the overwrite-prompt function to bypass stricter motion guidelines, or plain ComfyUI.
- A Python script builds the timeline from the score and marks which instrument is lit per frame; Verovio renders the score; the stage is HTML captured via HyperFrames with post-processing alignment checks.
Future pieces can be produced by dropping in a new composition, and the stage could extend to South Park–style theater. The piece riffs on Iain Banks' Excession. Feedback on musical issues welcome.
Related event: Claude-Composed Orchestra Performs in AI Paper Puppet Theater(2 posts)→
More from Fun
- Proton warns "don't give ChatGPT your address," the internet replies: it already knows — cocktailpeanut · 2026-10-24
- ML PhD in agroecology graduates, continuing as postdoc at Aarhus University — saheedniyi_02 · 2026-10-24
- Monkeys that lived through a deadly viral outbreak are far less likely to eat grapes on fake poop — Polymarket · 2026-10-24
- 'You Got Paid' vs 'Earnings Remittance Recorded': A Medieval Accounting Meme — wavefnx · 2026-10-24
- Sicily airport display board looks suspiciously vibe-coded, and people are worried — gethackteam · 2026-10-24
- Dev asks Kimi to perform an 'aesthetic review' of an image — banteg · 2026-10-24