OneShot MV: Open-Source ComfyUI Pipeline Turns a Song and One Sentence Into a Lip-Synced Music Video
luckyyirish · reddit · 2026-11-04
A developer open-sourced OneShot MV, a ComfyUI node pack + web Studio that produces a full lip-synced 1080p music video from one song and a one-line premise.
Pipeline
- Analyzes beats, sections, the drop, and vocal/drum stems
- Generates a world and cast from your prompt; images via Krea 2, QC'd and redone by Gemma 3
- Renders clips with LTX-2.3 lip-synced to the vocal stem, auto-retaking bad sync
- Auto-edits to the music with audio-reactive drum FX, color grade, grain
Usage
- Studio lets you preview the plan, review images, re-shoot any shot with a note, and tweak FX/grade without re-rendering
- Runs fully local on open weights: 24GB set for 3090/4090/5090 (needs 64GB RAM), full set for 48GB+ cards
- Built for Comfy's #OpenSourceHiggsfield contest; repo on GitHub.
More from coding & agent
- Zero-shot mobile manipulation demo stacks Dream-1 policy, MCP planner and ROS nav — scott_e_reed · 2026-11-04
- Anthropic launches Claude auto-connect beta, letting admins onboard whole orgs to MCP plugins — TansuYegen · 2026-11-04
- Coding agents build baselines for 36 top-journal AI methods, matching ~95% of scores — owl_posting · 2026-11-04
- Postman desktop auto-installs Codex/Claude plugins, tries to trust its own startup hook — jedisct1 · 2026-11-04
- Oracle's agentic AI product lead: enterprise AI roadmaps run on outdated use-case lists — akumar · 2026-11-04
- Sentdex: vibe coding is real, OpenHands shows dev may not involve reading code — Sentdex · 2026-11-04