Local LLM plus video models turn a novel into a trailer: 48-scene pipeline needs help
OpenEvidence9680 · reddit · 2026-09-12
The author already runs a pipeline in their CMS for generating custom book covers, and now wants to go further: a short trailer plus a long-form film for Guards! Guards! by Pratchett, a favorite book never adapted to film.
Current setup: a local LLM reads the whole book and produces a character list with descriptions, which Krea2 turns into character sheets (not ideal, but acceptable for a test). The same LLM writes a screenplay in three acts totaling 48 scenes, each with an action description and a Krea-generated still; the pipeline then generates clips to be joined. The author has made only a handful of 5-second videos before and used very basic txt2img for the covers.
Minimax is giving trouble (likely bad prompting), so they switched to ltx2.5, which does a decent job, but they started this morning and have only one scene done; a dragon head on a dragon's wing is not the worst issue. Hardware is two 5060 Ti 16GB cards plus 64GB RAM until a new PC arrives.
They are asking for advice on which models to use, available speedups, which models handle fantasy better, LoRA suggestions, whether LTX 2.5 supports first and last frames like 2.3, and any workflows that could streamline this.
Related event: Maker Uses Local LLM and Video Models to Adapt Novel into 48-Scene Film(2 posts)→
More from Multimodal
- "Neon Ronin": 20-second cyberpunk AI action sequence with synchronized Foley audio — Abhay-191 · 2026-09-12
- Cinematique: a free library of 150+ cinematic prompts for Midjourney, Runway & Veo — _AustinCalvert_ · 2026-09-12
- Reddit post: AI-generated video has become dangerously realistic — Old_Establishment287 · 2026-09-12
- Tencent open-sources AuK: a 1.5B speech model unifying generation and instruction-based editing — pmttyji · 2026-09-12
- Adobe Firefly Boards hands-on: an infinite canvas stitching 30+ AI models into one workflow — umesh_ai · 2026-09-12
- Little-Known Firefly Trick: Video-Input Background Music Generator Plus a Paper-Craft Prompt — umesh_ai · 2026-09-12