Red Hat releases an FP8-quantized Kimi-K3 checkpoint tuned for Hopper GPUs

_akhaliq · x · 2026-07-29

Red Hat AI released an FP8BLOCK-quantized checkpoint for Moonshot’s Kimi-K3, tuned for Hopper GPUs.

• The checkpoint is designed to run on NVIDIA H100/H200 with Hopper-native FP8 tensor core throughput.
• Red Hat says it has day-zero support with vllmproject.
• The Hugging Face model card notes the quantization was applied to MLP and expert layers, while attention layers were left unquantized because of shape mismatches.
• The repo is MIT-licensed and includes evaluation results plus the full quantization recipe.

Original post →

More from Infra

• Meta's commitments jumped to $349B in a quarter as server memory prices tripled ahead of Oct 21 earnings — tengyanAI · 2026-10-16
• Meta releases Muse Spark Open, trained with vLLM-powered RL inference from day one — colinmcnamara · 2026-10-16
• Meta's open Muse Spark needs 493GB of memory — far beyond any consumer laptop — TejasKumar_ · 2026-10-16
• CoreWeave plunges 20% as credit markets price >60% default odds; is this dot-com all over again? — kimmonismus · 2026-10-16
• MiniCPM-V 4.7 35B-A3B hits 17+ tokens/s on iPad with ~3GB memory — techNmak · 2026-10-16
• China rolls out 'token factories' and a 2026-28 token economy action plan — nordicinst · 2026-10-16

Infra channel →