8× B300 self-hosting could serve 30B tokens a month and pay back in under 100 days
JosephJacks_ · x · 2026-07-28
At 75% utilization, a K3 self-hosted stack on 8× B300s can reportedly serve more than 30 billion tokens per month.
The post estimates roughly $500K in compute plus under $10K in monthly opex, and says that at current API pricing of $3/input and $15/output per 1M tokens, the self-hosting payback period would be under 100 days. The punchline: if you run open weights at scale, self-hosting may pay for itself quickly.
Related event: Kimi K3 Self-Hosting Saves 60% Compute, Pays Off in 100 Days(2 posts)→
More from Infra
- A Stanford talk highlights a startup that cut its AI bill from $1.2M to about $100k a month — HeyAmit_ · 2026-07-28
- Agentic commerce still has a visibility problem despite tens of millions of payments on Base — Timwal123 · 2026-07-28
- OxygenREC-v2 folds rewardless discrimination into a 3B MoE recommender — _reachsumit · 2026-07-28
- Poster says the NVIDIA-linked release is still gated to approved Microsoft Foundry customers — davidmanheim · 2026-07-28
- Render open-sources an MCP server for deploys, logs, metrics, and Postgres — ojus_render · 2026-07-28
- Anduril’s containerized data center can be deployed by two people in under 10 minutes — damianplayer · 2026-07-28