Kimi K3 Parameters and Inference Margins Revealed
zephyr_z9 · x · 2026-07-19
The post mentions that Kimi K3 has a total of about 2.8T parameters, which scales down to roughly 1.4T when served in fp4. It is called one of the sparsest frontier models on the market, with a sparsity of only 1.7%.
It also provides an inference-side estimate: its inference business has a gross margin of at least 75%–85%. The following quote adds a perspective on DeepSeek—even if model weights and parts of the architecture are open-sourced, competitors still struggle to replicate its real cost advantages because key implementation details and operational experience remain proprietary.
Related event: Moonshot Releases 2.8T Open-Weights Model Kimi K3(14 posts)→
More from Infra
- Nebius secures $3.5B Citi financing facility for GPU purchases and AI data centers — Beth_Kindig · 2026-10-26
- Nearly half of Claude revenue now flows through cloud marketplace commitments, up from 11% — BenBajarin · 2026-10-26
- Anthropic ARR goes vertical after price cuts: tokens up 4x, $100B+ ARR back in play — GavinSBaker · 2026-10-26
- Alex Banks argues power caps GPU supply, real risk is demand cooling first — thealexbanks · 2026-10-26
- Analyst: Ant has the most fungible AI workload of any model provider today — BenBajarin · 2026-10-26
- Anthropic S-1: training infra edge cut per-task cost 40% and doubled revenue growth — BenBajarin · 2026-10-26