2.78T-param Kimi K3 runs inference on a single CPU in 8.24 GB RAM, no GPU or BLAS
udmrzn · x · 2026-09-11
A GitHub project demonstrates running 2.78-trillion-parameter Kimi K3 inference on a single CPU using just 8.24 GB of RAM — no GPU, no BLAS library, no inference framework. An extreme proof-of-concept for GPU-free local deployment of frontier-scale models.
Related event: 2.78T-Parameter Kimi K3 Runs on Single CPU with Just 8.24GB RAM(3 posts)→
More from Infra
- k3 Report Section Confirms Millions of Concurrent Sandboxes in Its RL Training Run — stochasticchasm · 2026-09-11
- k3 RL Run Reportedly Used ~50M Sandboxes With Millions Concurrent, Checkpoints Merged Across Scaffolds — stochasticchasm · 2026-09-11
- Pentagon in talks to lend roughly $5 billion to AI cloud startup Fluidstack — vitaliychiley · 2026-09-11
- Eric Schmidt: AI may hit a money wall before a power wall — $1T capital needed — rohanpaul_ai · 2026-09-11
- SpaceX signs another AI compute deal: $1.11B per month, on track for $100B ARR — NinaDSchick · 2026-09-11
- Carmack: Jetson Thor's 128GB at 273GB/s is over-provisioned for real-time robotics — ID_AA_Carmack · 2026-09-11