Huawei Open-Sources MACaQ, a Model-Agnostic Calibrated Quantization Method

Huawei's CSL team open-sourced MACaQ, a model-agnostic calibrated post-training quantization method that quantizes weights and activations to MXFP4 W4A4. It supports text, image, audio, video and 3D models, works with llama.cpp and vLLM, and achieves 23% lower KL divergence than Unsloth.

2026-11-11 ~ 2026-11-12 · 2 related posts