Running Kimi K3 on 29GB of RAM at 0.5 tok/s

marcobambini · hn · 2026-07-31

A developer shared an extreme resource challenge, demonstrating how to run the Kimi K3 model in an environment with only 29GB of RAM. Although the inference speed is just 0.5 tok/s, the project proves the technical feasibility of deploying ultra-large models on consumer-grade or restricted hardware.

Original post →

More from Infra

Infra channel →