Self-hosting Kimi K3 may pay back in under 100 days, but only after a $600K setup
steipete · x · 2026-07-29
- A thread argues that self-hosting Kimi K3 can look “super cheap” only after a very expensive setup: roughly $600K upfront, including 8× B300s.
- At about 75% utilization, the setup can reportedly serve 30B+ tokens/month with around $500K in compute plus < $10K/month in opex.
- Using current API pricing of $3/$15 per 1M input/output tokens, the post claims the payback period is under 100 days.
- The takeaway is that open-weight self-hosting economics can be attractive at scale, but only if you can absorb the initial capex and keep utilization high.
Related event: Kimi K3 Self-Hosting Can Break Even in Under 100 Days(4 posts)→
More from Infra
- Qualcomm goes agent-centric: Snapdragon 8 Elite Gen 6 and agent-native devices — jiqizhixin · 2026-09-23
- Unsloth Desktop Hotfix Adds Qwen-Image-2.1 Image Editing and Fixes GGUF Loading — danielhanchen · 2026-09-23
- Qwen 3.6 35B-A3B Q6 hits ~50 tok/s on a 128GB Strix Halo — what's the best local model now? — jankeydankey · 2026-09-23
- Together AI adds canary rollouts for zero-downtime model upgrades on dedicated inference — togethercompute · 2026-09-23
- Dedicated Hardware for Running AI Agents at Scale Arrives — cyrilzakka · 2026-09-23
- Ternary Bonsai 2 27B: 5.9GB weights retain ~95% of full-precision reasoning — cephaloform · 2026-09-23