Full-Song Lip-Synced MV with MiniMax H3 at 3 Steps: Method and Benchmarks
Disastrous_Page_301 · reddit · 2026-09-16
A Redditor detailed a full pipeline for a 2:50 lip-synced K-pop style MV using MiniMax H3 Extender: slicing audio at vocal pauses into 17 clips, isolating vocals with htdemucs, and using the fullycopy retention syntax (without it, lip movements degrade to gibberish). With the TaoMate 3-step turbo LoRA, a 9.4s clip renders in 4–5 min on an RTX 3090 (vs 12.5 min at 8 steps), achieving 0.944 audio-envelope correlation and zero seam loss. An automated four-jury QC loop (audio alignment, Vision LLM lipsync scoring, camera stability, defect voting) auto-rerolls failing clips. Limitations: suppressed camera motion at 3 steps and occasional phoneme drift.
More from coding & agent
- Microsoft's MemSteer turns unlabeled user histories into agent memory supervision — MicrosoftResearch · 2026-11-02
- She fired herself from her own Instagram: AI agent runs the account, views up 82.3% — heyshrutimishra · 2026-11-02
- Sourcegraph: AI writes code faster than teams can review it, driving more outages — AI Engineer · 2026-11-02
- Tsinghua & Microsoft's HarnessMM cuts agent token use by up to 87.93% while raising success rate — rohanpaul_ai · 2026-11-02
- GitHub launches Agent HQ: Anthropic, OpenAI, Google coding agents in Copilot — emmanuelvivier · 2026-11-02
- DeepSeek open-sources Super-Agent, a coding agent that reads team chats to minimize human input — emmanuelvivier · 2026-11-02