Open-Sourced MiniMax-H3 Ref-V2V Workflow: Precise Regional Motion Control
Primary_Internal9365 · reddit · 2026-08-08
Searching for a local, controllable alternative to closed APIs like Kling or Gemini, the author built a Reference Video-to-Video (Ref-V2V) ComfyUI workflow based on MiniMax-H3 and open-sourced a custom node.
Core Techniques & Solutions:
- Custom Attention Mask Node: Hooks into DiT self-attention layers, integrating with SAM3 for region-specific control (e.g., locking character motion while replacing backgrounds).
- Smart 32-Multiple Padding: Dynamically applies Reflect Padding to round input resolution to the nearest multiple of 32, preventing dirty resizing and resolution loss.
- 17-Frame VAE Sync: Automatically matches the temporal VAE packing rules to prevent decoding crashes or abrupt truncations.
- Boundary Drift Fix: Implements a Head & Tail Freeze Frame Padding system (15 dummy frames each) to solve motion warping at the video's end.
The author also highlights an unsolved mystery: the frame index offset required for trimming fluctuates between 15 and 30 across different videos. Tested on an RTX 5090, the workflow supports an unofficial 4-step Turbo LoRA for acceleration.
More from coding & agent
- Sourcegraph Traces 517K Commits to Reveal AI Agent Adoption in Open Source — heyneighbor · 2026-08-08
- EverMind Releases Three Papers on Full-Stack Self-Evolving AI Architecture — 量子位 · 2026-08-08
- Subject matter expertise is crucial in AI agent development — rachittshah · 2026-08-08
- Qwen3.8-Max Matches GPT-5.6 in Coding Game Test at Quarter the Cost — rohanpaul_ai · 2026-08-08
- Agentic Long-Horizon RL: Weighing Batch Size and Gradient Update Strategies — ShikharMurty · 2026-08-08
- Ant Group & RUC Introduce SearchOS: Shared Memory Prevents Search Agent Loops — jiqizhixin · 2026-08-08