Running 2.78T-param Kimi K3 on a single CPU in 8 GB RAM, no framework
tom_doerr · x · 2026-09-22
The open-source kimi-k3-in-c project runs the 2.78-trillion-parameter Kimi K3 on a single CPU using 8.24 GB of RAM, in portable C99 with no BLAS, no framework and no GPU. It has garnered 8.1k stars as an extreme local-inference/memory-efficiency engineering effort.
More from Infra
- 63% of Americans oppose data centers in their community, spanning both parties, pollster says — AlexTensor · 2026-09-22
- Toby Ord estimates $20M spent on AI's millennium prize result, $200M for solid data — tobyordoxford · 2026-09-22
- What engineers check before adding a new LLM provider — Rama_Surasani_ · 2026-09-22
- Dev reverse-engineers DLSS 5 neural rendering, reimplements it bit-exact in Vulkan at 7.8ms/1080p — bdsqlsz · 2026-09-22
- M5 Ultra Hits 3740 tok/s Prefill on Qwen, Nearly Double Overnight — EAccelerate_42 · 2026-09-22
- LinkedIn's GPU Pre-Ranker Fuses Graph Features for 50x Bigger Models at 120ms p99 — _reachsumit · 2026-09-22