GGUF models can now run directly in Hugging Face transformers with ggml Metal kernels
pcuenq · x · 2026-09-22
GGUF checkpoints from llama.cpp can now run natively in Hugging Face transformers. The work ports ggml's Metal kernels into the transformers ecosystem, improving compatibility and enabling faster local inference on Mac — millions of downloaded llama.cpp models now have one more way to run without conversion.
Related event: Transformers Natively Runs GGUF, Matching llama.cpp Performance(8 posts)→
More from Infra
- Gas-for-AI-datacenters forum co-located with CoRL shows energy demand spillover — carlosdponx · 2026-11-12
- a16z podcast: Mike Volpi on Cisco's 70+ acquisition playbook and the AI buildout — a16z · 2026-11-12
- AMD to pass Intel in server revenue by mid-2027 as share gains 6 points a year — BenBajarin · 2026-11-12
- Study: Reflective Data Center Roofs Actually Cool Daytime Ground by 1.8-2.2°C — SumitGup · 2026-11-12
- Tsinghua's BaGuaLu-2 tames MoE expert-load spikes at runtime, accepted to SC26 — jiqizhixin · 2026-11-12
- antirez backs low-bit DeepSeek 4.1 Flash over Qwen 27B dense on Apple M5 Macs — antirez · 2026-11-12