Run Kimi K3 at home: tinygrad hits 40 tok/s interactive for about $30k
StephanSturges · x · 2026-10-30
tinygrad shared a setup to run Kimi K3 locally at 40 tokens/s interactive, with hardware costing around $30k. Stephan Sturges quote-shared it, predicting we'll see much more of this — frontier-scale models running at home.
More from Infra
- Epoch data: leading chips get ~40% more efficient yearly, but AI power draw keeps climbing — teortaxesTex · 2026-10-30
- Why do some unified AI API gateways offer rates far below official pricing? — Lin_len · 2026-10-30
- JevBench v1.8 crowns mammoth-1 atop open-weights board, now prices models by GPU time — airesearch12 · 2026-10-30
- MiniMax H3 video-to-video on 8GB VRAM: 832x640 renders in ~19 minutes on RTX 4070 — big-boss_97 · 2026-10-30
- Artificial Analysis Overhauls Intelligence Index v5, Reshuffling the AI Leaderboard — The AI Daily Brief · 2026-10-30
- EdgeQuake v0.38: a full GraphRAG stack in Rust with 2.3k GitHub stars — JeremyCMorgan · 2026-10-30