H3 Fun ControlNet Brings Control-Video Guidance for MiniMax-H3 to ComfyUI
wyzborrero · reddit · 2026-08-27
A developer open-sourced ComfyUI-H3-FunControl, the first way to drive MiniMax-H3 video generation with a control video in ComfyUI: depth, canny, pose, HED and MLSD all work (the underlying model is a union adapter). Control sources can be 3D renders, estimators over reference footage, hand-drawn frames or ComfyUI preprocessors; generation follows the structure frame by frame.
Why it didn't exist: Alibaba PAI's MiniMax-H3-Fun-Controlnet-Union ships full-width AdaLN, while the pruned H3 checkpoints most people actually run are curve-form — incompatible. Using the official ControlNet meant the 34GB unpruned base and adherence still failed. Kijai re-derived the ControlNet into the curve-form basis, after which a control block is literally comfy's DiTBlock and the AdaLN is an unmodified AdalnProj; this node is the glue.
Practical notes (the README is largely a list of failure modes): chained control towers sum — depth 1.0 + pose 1.0 behaves like a single control at 2.0 and saturates, treat strength as a budget; pose held the subject in the author's test while depth let camera distance drift; endpercent matters more than it looks — held at 1.0 the control asserts itself during texture formation and suppresses prompted texture; with Sol-Attn, morton must be off or control silently fails, producing a clean video that ignored its input. Apache-2.0, three annotated example workflows, tested only on an RTX 5090.
More from Multimodal
- VFX Studio Complains: ComfyUI's Memory Management Causes Nightly OOM Crashes — vfxthrowawaydotcom · 2026-08-27
- Google releases Omni 1.1 Flash with 4K output and frame interpolation — legit_api · 2026-08-27
- Single-Word Prompt #3: Old English 'Ūhtcaru' Turned Into Midjourney Art — tisch_eins · 2026-08-27
- Hark partners with NVIDIA for gigawatt-scale compute on Vera Rubin platforms — adcock_brett · 2026-08-27
- Minimax H3 Local Benchmark: 5-Second Clip Takes 4 Minutes on AMD 7900XT — thevictor390 · 2026-08-27
- MiniMax video generation drifts: lavish ballroom scenes keep degrading into drab curtains — Speeeedee · 2026-08-27