Hardcore C99: Running 2.78T Kimi K3 on CPU with 8GB RAM
AutomaticDriver5882 · reddit · 2026-08-14
A hardcore open-source project named kimi-k3-in-c has surfaced on GitHub. It demonstrates running the massive 2.78-trillion-parameter Kimi K3 model on a single CPU using only 8.24GB of RAM.
The project is written entirely in portable C99 without relying on any BLAS libraries, AI frameworks, or GPU acceleration. This extreme lightweight deployment offers a new approach to running massive models on edge devices or legacy hardware.
More from Infra
- TPN Labs Announces Mainnet Competition to Tackle Edge AI Model Size Limits — const_reborn · 2026-08-14
- New Brain-Inspired AI Chip Solves Problems With 10,000x Fewer Calculations — ChuckDBrooks · 2026-08-14
- Architect Labs Uses AI to Design Custom Chips, Eliminating Need for In-House Semiconductor Teams — hsu_byron · 2026-08-14
- Qwen 30B MoE on RTX 3050 6GB: 30+ tps with 90k context — Bakkario · 2026-08-14
- Minimax with ref2va quantization runs on low VRAM — Actual-Project358 · 2026-08-14
- Continuous Batching in LLMs: The Tech Behind vLLM's 23x Throughput Jump — blaizedsouza · 2026-08-14