Moonshot releases weights for a 2.8T frontier model and more run-time infrastructure
0xSammy · x · 2026-07-28
Moonshot’s Kimi has released the weights for a 2.8T-parameter frontier model, along with more of the infrastructure needed to actually run it.
The post frames this as evidence that frontier intelligence is becoming an open commodity: instead of spending billions to train a model from scratch, companies can build on top of open models and shift value toward the infrastructure layer — GPUs, distributed compute, inference, data, and agents.
Related event: Moonshot AI Releases Open-Weight Kimi K3 Model(35 posts)→
More from Infra
- Kimi K3 paper details Attention Residuals and a block design that cuts memory use — suchenzang · 2026-07-28
- vLLM ships day-0 serving support for Moonshot’s 2.8T-parameter Kimi K3 — vllm_project · 2026-07-28
- Kimi K3 deployment estimate points to 2 B200 nodes or 1 B300 class node — HarveenChadha · 2026-07-28
- MLA-based KV cache costs 12 GB per million tokens, with KDA state at 230 MB BF16 — zephyr_z9 · 2026-07-28
- A 70B GGUF model stalls on an AMD R9700 as VRAM hits 30 GB but RAM stays flat — Developer-Y · 2026-07-28
- Reddit debates the cheapest practical way to run K3 locally — ylchao · 2026-07-28