Replacing MiniMax H3's 32B Text Encoder with 4B/8B Models: An Update

Fit_Ad7343 · reddit · 2026-08-10

The MiniMax H3 video generation model originally relied on a massive 32B parameter text encoder (taking up 15.7 GB VRAM) to process prompts. A developer attempted to replace it with a Qwen3-VL 4B or 8B model combined with a learned mapping network to reduce resource consumption.

In a recent proof-of-concept update, the developer successfully resolved previous issues—such as low audio volume, hitting a ceiling in instruction following, and inaccurate generation of specific individuals—by introducing a small residual network and supplementing with a TMDB celebrity dataset. The 4B and 8B replacement versions now show significantly improved instruction following, and the related code and matrix weights have been open-sourced.

Related event: Replacing MiniMax H3's 32B Encoder with Smaller Models Tested(2 posts)→

Original post →

More from Multimodal

Multimodal channel →