Building an AI sci-fi serial: a 5-episode workflow with Flux, Kokoro TTS and pitfalls
darkcashxtr · reddit · 2026-10-08
A creator shares the full pipeline behind his AI-assisted sci-fi serial (narrated slideshows following humanity across 1,000 years from 2100), after 5 episodes:
- Pipeline: prose co-written with Claude using tags like [NARRATOR] and [PRIME] to map lines to voices; Kokoro TTS with one voice per tag; one Flux prompt per script beat (episode 5 alone has 381 images); editing synced via Python script and CapCut.
- What broke: Flux garbles any text inside images (screens, signs, labels), so frames are reviewed and dropped; episodes neared 50 minutes and were split into two 20-minute parts.
- TTS findings: Zonos 2 was a disappointment (voice tags made it sound drunk); Qwen3-TTS matched Kokoro at its best but derailed with emotional tags and seems to only work well via their cloud platform; Kokoro remains the only viable local option, albeit flat.
- Open problems: adding real emotion to local TTS (shaky voice, nervous laugh, whisper) and keeping characters visually consistent across hundreds of generated images.
More from Multimodal
- Runway launches MCP: generate video in ChatGPT, Claude, Grok and Cursor from one chat — runwayml · 2026-10-08
- Runway brings its video generation directly into ChatGPT: brief, generate, and give notes in one chat — runwayml · 2026-10-08
- Gossip Goblin Held Up as Proof AI Art Can Rise Above the Slop, With a Movie Trailer — PossibleVariety7927 · 2026-10-08
- 128,000 Micro-Dramas Launched in Q1 2026, Over 95% AI-Generated, Epoch AI Reports — Jsevillamol · 2026-10-08
- LiveAvatar Drops 30 New AI Avatars With 6 Emotions and Full-Body Streaming, Free Now — alifcoder · 2026-10-08
- First MPA-approved AI film 'Gods Don't Give Gifts' heads to theaters, R-rated, submitting for Best Animated Feature Oscar — emmanuelvivier · 2026-10-08