Claude Code rebuilt its own ComfyUI pipeline to fix prop continuity in a 2-min AI film
Odd_Definition_9724 · reddit · 2026-10-26
A practitioner had Claude Code autonomously create a 2-minute ComfyUI short film (FLUX 3 Klein + LTX-2.5, one local GPU). After viewers caught the paper crane changing between shots, the agent rebuilt the pipeline. Four fixes did most of the work:
- Cast the prop first: one canonical crane reference image fed into every keyframe, with a red-seal marker on the body (not a wing) and fixed screen-right orientation.
- Layout boxes over reference over-anchoring: reference alone pasted the crane at identical size/pose every frame; a bounding box with chosen size fixed it.
- Reject at storyboard, not clip: six seeds per shot with a gate checking native-size crops and forbidden elements.
- Puppet staging for rigid props: letting the crane fly made it melt; holding its pose and moving camera, light and sea kept 12/12 shots consistent.
Audio was picked by loudness-peak placement across multiple generated scores. All frames, rejects and workflow are public (disclosure: author works on numonic.ai).
More from coding & agent
- A /be-ambitious Claude skill turns Ethan Mollick's 'more ambitious' AI advice into a workflow — daniel_mac8 · 2026-10-26
- Grok Bot hands-on: can't edit existing Google Sheets, DM permission gaps — koltregaskes · 2026-10-26
- How to turn Claude Code into a video editor: a full reel in 19 minutes — PrajwalTomar_ · 2026-10-26
- Paper: agent failures stem from context bloat, not reasoning — quadratic token cost, accuracy cliff — import_jmr · 2026-10-26
- Open-source course teaches harness engineering by building Claude Code from scratch: 8 articles, 6 videos — kalyan_kpl · 2026-10-26
- EpochAI reviews 8 agent benchmarks: only 1 verified, 3 flawed — and coding agents may break the reward trilemma — May_F1_ · 2026-10-26