Benchmark on Blackwell: mxfp6 GEMM only slightly faster than mxfp8, fp4 far ahead

AnushElangovan · x · 2026-11-19

An experiment with mxfp6 GEMMs on Blackwell GPUs: throughput is only slightly above mxfp8, while (mx/nv)fp4 GEMMs are much faster than both. A commenter adds that MI355 owners should try the same — there mxfp6 will likely land closer to mxfp4.

Original post →

More from Infra

Infra channel →