Microsoft open-sources bitnet.cpp: 100B-parameter 1-bit LLM on a single CPU, 82% less energy
dr_cintas · x · 2026-11-18
Microsoft open-sourced bitnet.cpp (41.6k GitHub stars, MIT license), its official inference framework for 1-bit LLMs, claiming a 100B-parameter BitNet model can run on a single CPU without a GPU.
- Up to 6.17x faster on x86 CPUs and up to 82.2% less energy.
- Recent additions include VibeASR.cpp, a real-time multilingual ASR engine on CPU using BitNet I2S quantization (RTF < 1 with few threads on AVX2/NEON), and the first 1-bit embedding models BitNet-embedding-0.6B and 270M.
More from Infra
- Blackstone warns Anthropic will debut as junk-rated after record IPO, clouding $63B chip financing — deliprao · 2026-11-18
- Japan's supercomputer Fugaku hacked, nearly 4,600 users' credentials at risk, now offline — saibharadwaj · 2026-11-18
- SGLang-Neuron v0.1.0 open-sourced: SGLang serving stack lands on AWS Trainium — testingcatalog · 2026-11-18
- Harvard: 400 largest US data centers emit as much greenhouse gas yearly as Denmark — geoffwolfe · 2026-11-18
- TomorrowX pitches: open source closing on frontier models, Nvidia's software moat is gone — PTrubey · 2026-11-18
- Astera Labs CEO: demand outlook unchanged, customers just want product faster — BenBajarin · 2026-11-18