Viggle-Animate open-sourced: replace video characters from one repainted frame, no pose estimator
cocktailpeanut · x · 2026-09-07
Viggle released Viggle-Animate on Hugging Face: a 33.1B full finetune of MiniMax-H3's ref2va transformer, distilled with DMD to just three forward passes.
- Workflow: repaint the character into one frame of the video; the model propagates the edit across the shot, keeping motion, camera and timing untouched
- No pose estimator, segmentation mask, face tracker or text encoder needed — two inputs, three forward passes, 26 seconds per shot on one GPU
- Since the reference is a frame of the clip itself, pose, framing and lighting align naturally; the model never needs to be told what the new character is
- Strong where replacement is hardest: fast motion like head whips, full kicks and jumps, tracked frame by frame
- cocktailpeanut's hands-on test found quality exceeded expectations — three steps on a local PC
Released under the minimax-h3-community-license.
Related event: Viggle-Animate Goes Open Source for Character Swap Videos(4 posts)→
More from Multimodal
- High-res tiled Marigold V2 depth maps arrive in ComfyUI with See Through model — AntonObukhov1 · 2026-10-27
- AI filmmaker PJaccetturo discusses building his NEXUS universe with Dreamina — DavidmComfort · 2026-10-27
- Runway launches App Studio: build no-code creative apps that generate image, video and audio — runwayml · 2026-10-27
- MiniMax H3 runs Maestro locally for free; Kling 4.0 vs Seedance 2.5 video editing compared — cocktailpeanut · 2026-10-27
- AI-generated movie-grade clip goes viral, blurring the line with real cinema — cneuralnetwork · 2026-10-27
- 10 practical ways to run Astra computer use on Premiere Pro for video editing — beechinour · 2026-10-27