Full-AI music video pipeline with Suno, ChatGPT reference frames and Pika H3 Flex lip-sync, reviewed
Inevitable-Bus-8654 · reddit · 2026-11-09
Following an earlier LTX 2.5 rap video, the author built a melancholic AI music video (One Last Bullet) and shared the full workflow: Suno for the song, ChatGPT Images for consistent performer reference frames, and Pika H3 Flex Ref2VA on the MiniMax H3 base, run via Python/Diffusers on a single Runpod H200.
Pipeline: 1344×768 at 24fps, six model evaluations per shot; each 5s take uses a reference image plus the matching song excerpt, with singing lip-sync from audio conditioning; FFmpeg assembly.
Remaining issues: faces soften when the performer is far from camera; lip-sync still drifts in some takes; testing NVIDIA Open-H3-Regenerate-2K shifted mouth timing, so preview stays at native resolution.
More from Multimodal
- Grim Reaper megastructure AI art stuns with apocalyptic scale — LudovicCreator · 2026-11-09
- User generates a full anime music video locally with MiniMax H3 in under 15 minutes — No_Range_8261 · 2026-11-09
- Two-pass workflow fixes flat AI acting and voice in MiniMax H3 video generation — infearia · 2026-11-09
- Google's AI Mode lets users turn selfies into Diwali greeting cards — ctjlewis · 2026-11-09
- AI image gen fail: prompt for interior design produced a McDonald's-themed strip club — cyrus_zei · 2026-11-09
- Vocal synth models vocal tract as branching acoustic tubes, not spliced phonemes — flngr · 2026-11-09