Transformers now runs GGML kernels, matching llama.cpp performance

LysandreJik · x · 2026-09-22

LysandreJik of Hugging Face announced that Transformers can now run models via GGML kernels through the kernels library, achieving the same performance as llama.cpp — instead of merely loading GGUF files and unquantizing them. As a proof of concept, two architectures are supported so far: Qwen 3.5 and its MoE counterpart.

Even more promising: models not supported by llama.cpp can still leverage its GGML kernels. Modalities like raw CV, diffusion, and TTS — which need heavy pre/post-processing and are hard to fit into llama.cpp — can reuse these high-performance kernels without GGUF files. Still proof-of-concept, but very promising. The kernels live on the HF Hub under the GGML org.

Related event: Transformers Now Calls GGML Kernels Directly, Matching llama.cpp Performance for GGUF(6 posts)→

Original post →

More from Infra

Infra channel →