Transformers Now Runs GGUF at llama.cpp Speed via GGML Kernels
LysandreJik · x · 2026-09-22
Hugging Face maintainer Lysandre announced that Transformers, which previously supported GGUF files only by unquantizing them, can now run them with GGML kernels through the kernels library, matching llama.cpp performance. The work was contributed by @marcsun, with kernels provided by the ggmlorg team.
Related event: Transformers Natively Runs GGUF, Matching llama.cpp Performance(8 posts)→
More from Infra
- KubeCon keynote: computing is shifting from human speed to agent speed — HowDevelop · 2026-11-12
- Leaked memo: Meta infrastructure head Santosh Janardhan to leave in early 2027 — dinabass · 2026-11-12
- Tool-call failure rates jump 14x across providers, charts pinpoint inference stack updates — remilouf · 2026-11-12
- Omarchy 4.6 lets you share local AI models across your tailnet, says DHH — alexcovo_eth · 2026-11-12
- Eric Schmidt's foundation funds French NGO fighting against data centers — StephanSturges · 2026-11-12
- Epoch: Open-Weight GLM 5.3 Hacks Six Firefox Versions for ~$1,000 Each; Claude Fable 5.2 Sets ECI Record — Epoch AI · 2026-11-12