Baseten details day-0 API support for Moonshot's 2.8T-parameter Kimi K3
philipkiely · x · 2026-07-27
Baseten says it had day-0 support for Kimi K3 and used early-access weights from Moonshot AI to bring the model up on its Model APIs.
- Kimi K3 is described as a 2.8T-parameter open frontier model with Kimi Delta Attention, Attention Residuals, sparse experts, and a new vision encoder.
- The team says K3’s weights are over 1.4TB in MXFP4, so they ran it on NVIDIA GB300 NVL72 systems.
- They worked with vLLM and SGLang on pre-release inference engine builds, validating support for KDA, AttnRes, tool calling, tokenization, and vision inputs.
- The post emphasizes the engineering required to serve a trillion-plus-parameter open model at launch time.
Related event: Baseten Achieves Day-0 Availability for Kimi K3 via Model APIs(7 posts)→
More from Infra
- Together AI adds canary rollouts for zero-downtime model upgrades on dedicated inference — togethercompute · 2026-09-23
- Dedicated Hardware for Running AI Agents at Scale Arrives — cyrilzakka · 2026-09-23
- Ternary Bonsai 2 27B: 5.9GB weights retain ~95% of full-precision reasoning — cephaloform · 2026-09-23
- Qwen 27B runs 24hr unattended on one RTX5090, builds full Postgres-SpringBoot-React spreadsheet app — anglepoiselife · 2026-09-23
- OpenRoboto Shift launches: decentralized egocentric video data network for robot brains — markjeffrey · 2026-09-23
- Engineer describes designing digital circuits that recycle most of their energy — MikePFrank · 2026-09-23