llama.cpp crosses 134k GitHub stars as the default local LLM inference stack
ggml-org · github · 2026-11-12
ggml-org's llama.cpp reached 134,239 GitHub stars (+162 today), with 2k contributors and 25k forks, cementing its role as the de facto C/C++ stack for local LLM inference.
More from Infra
- SpaceX's Southaven data centers net local schools and county $63M a year — 0xAllen_ · 2026-11-12
- Quantum infrastructure firm Q-CTRL announces Series C led by Salesforce Ventures — MJBiercuk · 2026-11-12
- Voxel pagoda generated fully local on a GPU-less 2020 ThinkPad with a 35B MoE model — dai_app · 2026-11-12
- Nebius Q3: $12B in customer commitments, revenue up 68% to $981M as GPU prices climb 22% — demian_ai · 2026-11-12
- 1T-Parameter MoE trained on EU public supercomputer with PyTorch, per-GPU throughput up 14x — PyTorch · 2026-11-12
- TensorFold: a Zig LLM inference engine spanning Metal, CUDA and Vulkan — ashhart · 2026-11-12