Fixing MiniMax H3 Black Frames on Legacy GPUs: FP16 Mix Cuts Inference 11x
Bubbly_Lawfulness_43 · reddit · 2026-08-08
MiniMax H3 officially only supports bf16/fp32, forcing older GPUs like the V100 to run at a crawl in fp32, while forcing fp16 outputs pure black frames.
A developer investigated and found that three specific places in the model's DiT architecture overflow fp16's max value (text-conditioning projection, attention-sink rows, etc.). By creating a custom node that keeps only these three spots in fp32 while running the rest in fp16, they achieved flawless inference on the V100 without quality loss. Speed dropped from 350s/step to 30s/step, an 11x speedup.
The fix is open-source, plugs directly into ComfyUI, and safely self-disables on modern bf16-supported hardware.
More from Infra
- Tesla's Magnet Expertise Could Help Musk Tackle Chip EUV Lithography — beffjezos · 2026-08-08
- Ex-OpenAI Co-founder Brockman Rumored to Tackle Silicon Supply Chain — beffjezos · 2026-08-08
- TensorLens: Inspect HF Model Quantization Layouts Directly in Your Browser — Brilliant-Hall1387 · 2026-08-08
- RAMageddon: 2027 Memory Capacity is Reportedly Sold Out — johnnyApplePRNG · 2026-08-08
- Running Cosmos3-Nano on RTX 5090: FP8/NVFP4 Quantization Fits in 32GB VRAM — fengwang_2_718281828 · 2026-08-08
- Microsoft Open-Sources BitNet: Running 100B LLMs on a Single CPU at 1.58 Bits — JafarNajafov · 2026-08-08