Built by Claude: a story-to-video pipeline wiring local LLM storyboards into Krea 2 and MiniMax H3
hirovomit · reddit · 2026-10-30
A Redditor had Claude design and build a one-click story-to-video pipeline: a local LLM (Ollama) storyboards a pasted story into JSON scenes with locked character descriptions, then writes model-specific prompts using MiniMax's official R2V guide; ComfyUI acts as a render farm over HTTP, routing to Krea 2 stills or 10s MiniMax H3 clips with Krea-generated character sheets wired as <Picture N> references. Notable engineering details: resumable renders, an editable plan.json, per-reference-count workflow exports, and a mock test Claude wrote that caught its own ref-ordering bug. The author is crowdsourcing next steps: multi-angle character sheets, continuity passes, first/last-frame chaining, auto-stitching with TTS narration, and cheap preview loops.
More from coding & agent
- Claude API docs reveal beta Agents, Sessions and Environments APIs with managed sandboxes — aigclink · 2026-10-30
- Graph embeddings in one line: FastRP by default, GraphSAGE for attributes — JeremyCMorgan · 2026-10-30
- CodeRabbit CEO: $8M seed rounds no longer enough as 'software factories' need tokens; Garry Tan pushes back — garrytan · 2026-10-30
- GBrain Cloud launches a CLI: one command spins up a cloud AI workspace — garrytan · 2026-10-30
- Designing a multi-bot AI automation system to run one person's life and three businesses — Xeriphy · 2026-10-30
- "The agents of the internet of things" — a catchy frame for device-side agents — sull · 2026-10-30