MiniMax H3 Effectively 20.1B Parameters After Pruning, Fits in 24GB VRAM

Iwaku_Real · reddit · 2026-08-03

MiniMax H3 is confirmed to have 33.1B parameters, but testers found that the AdaLN projections only use 1 input, allowing weight patching to save up to 26GB VRAM (13GB for INT8, 6.5GB for INT4/NVFP4) with zero quality impact. The pruned INT8 model is about 20GB, fitting in 24GB VRAM of RTX 3090/4090 or RX 7900 XTX. The text encoder Qwen3-VL-32B is also pruned to 25.9B parameters (50/64 layers). Including video and audio VAEs, total is 48.8B parameters, but not all need to be loaded simultaneously. Speed: on a 3060 12GB, generating a 5-second 480p video takes about 9 minutes; a 5090 would take around 2 minutes.

Original post →

More from Multimodal

Multimodal channel →