vLLM and Ant Group Release Humming: Fast, Flexible Quantized Inference Kernels
vLLM Blog · rss · 2026-10-21
The vLLM blog announced Humming, an open-source quantized inference kernel library built by Ant Group and the vLLM community. It supports a broad range of GPUs and quantization schemes, covers both dense and MoE models with published performance results, and is integrated into vLLM for faster, more flexible quantized serving.
More from Infra
- IFM open-sources RL360: 8,192 concurrent sandboxes and ~1.3M rollouts for agentic RL — rupspace · 2026-10-23
- SpaceX seeks access to 80,000 US cell tower sites; Polymarket puts carrier odds at 29% — Polymarket · 2026-10-23
- Modular open-sources MAX framework to free AI compute from single-vendor lock-in — clattner_llvm · 2026-10-23
- Claude Models on Google Cloud (Anthropic managed) is now generally available — claudeai · 2026-10-23
- Scaling GLM-5.3-Flash training to 1M token context, 64x over Megatron baseline — AndrewLBeam · 2026-10-23
- Perplexity's Portable Computer lands on AMD Ryzen AI Max, running local 27B model — AravSrinivas · 2026-10-23