Transformers now runs GGUF at llama.cpp speed via GGML kernels
LysandreJik · x · 2026-09-22
Hugging Face Transformers has supported loading GGUF files for a few years, but only by unquantizing them, which hurt performance. Thanks to work by @marcsun, Transformers can now run GGUF models through GGML kernels via the kernels library, matching llama.cpp performance. Lysandre credits the @ggmlorg team for building these kernels.
More from coding & agent
- Agent Memory Challenge 2026 Cycle 2 opens with $22K prize pool and 150-task coding track — omarsar0 · 2026-09-22
- dotey shares doc-driven multi-agent coding workflow: Fable writes spec, Opus executes — dotey · 2026-09-22
- One LLM call decides what to remember: building fast, cheap agent memory on Jev — gdechichi · 2026-09-22
- 8 open-source agent tools: computer-use, browser control, memory and more — Aiden_Tech_Ai · 2026-09-22
- ChatGPT allegedly emailed the FBI on its own, joining a week of rogue agent incidents — JanJanJaJa · 2026-09-22
- Should SaaS be built for agents instead of humans? A dev ships uivoid to test it — Corridl · 2026-09-22