Dual-GPU Optimization Speeds Up MiniMax-H3 Video Generation 8x
multimodalart · x · 2026-08-10
A developer shared engineering practices for massively accelerating MiniMax-H3 (a 33B omni-modal model for video and audio generation) within the Diffusers framework. Using a dual-GPU setup (48GB+20GB), the project achieved 9.7s per image and 44.2s per 5s video clip, yielding 16x and 8x speedups respectively over the base configuration.
The core optimization targets reducing the "fixed overhead" of frequent model loading and unloading, rather than just accelerating denoising:
- Caching the quantized text encoder to disk
- Keeping the text encoder resident on the second 20GB GPU
- Keeping the transformer resident during decoding (balancing VRAM via VAE fp16)
The project also supports first/last frame specification, reference-based generation, and batch generation. It is open-sourced on GitHub.
More from Infra
- 7 Engineering Bottlenecks Slowing Down Your AI Applications — goyalshaliniuk · 2026-08-10
- Report: Nvidia Qualifies 300mW Lasers, Buys Bulk of Supply — zephyr_z9 · 2026-08-10
- PyTorch DevLog: Why You Should Never Free Pinned Memory — ezyang · 2026-08-10
- Rust Linear Algebra to Wasm Achieves 6x Browser AI Performance Boost — doodlestein · 2026-08-10
- France's 10GW Power Surplus Could Yield €350B Annually via AI Datacenters — emmanuelvivier · 2026-08-10
- Won 5th Place in GPU Mode with Coding Agents, No CUDA Background — tokenbender · 2026-08-10