Full 4-minute AI music video made locally on one RTX 4090, 74 shots beat-locked
PatBQc · reddit · 2026-10-24
Reddit user PatBQc made a 4-minute fan music video for The Flaming Lips' "Pompeii am Götterdämmerung" entirely locally on a single RTX 4090 — no cloud, no paid APIs — and shared the full pipeline:
- Beat-driven editing: stem separation (Demucs htdemucsft + BS-RoFormer) and beat tracking via beatthis (70 BPM, 3.42 s bars); 74 shots cut frame-accurately on the beat grid, plus an audio-reactive pass (Python + OpenCV) with kick-driven zoom punches, bass-driven glow and snare micro-flashes.
- Generation pipeline: Qwen-Image 2.1 (int8 + turbo LoRA, 8 steps) for 300 stills and 3 keyframes per shot; MiniMax H3 Ref2VA for video (153 takes for 74 shots, 4 GPU-hours), using drum/vocal stems as reference audio; LatentSync 1.6 for lip-sync on sung shots; SeedVR2 7B upscale to 1080p (5 GPU-hours).
- Automated QA on every take: ArcFace for identity, DINOv2 for hidden cuts/morphs, SyncNet for lips, and a local Qwen3-VL-8B judge for anatomy/duplicates/anachronisms — plus manual contact-sheet review since the judge raises false alarms.
- Custom Python + ffmpeg edit; three visual registers from photoreal Pompeii to cosmic psychedelic transcendence.
Lessons learned are in the comments; the author is answering questions.
More from Multimodal
- Dev Vibe-Codes MOSS Image Studio, a Friendlier Browser Frontend for ComfyUI — Roorem10 · 2026-10-24
- Claude skill claims to replace Higgsfield Genjutsu with Seedance 2.5 video editing — aziz4ai · 2026-10-24
- Artist creates a 3D parallax comic book with Lattice, waitlist open — PurzBeats · 2026-10-24
- Star Vixens 2099: a sci-fi poster made in 2 weeks on an RTX 3060 with MiniMax and LTX 2.5 — Accurate_Village2024 · 2026-10-24
- LTX 2.5 distilled 22B Q4 runs locally on an 8GB M1 MacBook Air — 36s of video per ~32min render — iJohnnyRobert · 2026-10-24
- Open-source Claude Code skill turns any SVG into professional 60fps animation — rudrank · 2026-10-24