Google Cloud adds Day 0 SGLang support for Moonshot’s 2.8T Kimi K3 on GKE
ying11231 · x · 2026-07-29
Google Cloud has announced Day 0 support for Moonshot’s Kimi K3 with SGLang.
The guide shows how to serve the 2.8T-parameter MoE model on GKE, including DSPARK speculative decoding. It emphasizes that models at this scale are primarily an infrastructure problem: Google’s A4 and A4X VMs provide the memory bandwidth and interconnect needed to keep K3 fast under real concurrency.
Google outlines three deployment paths:
- Model Garden
- AI Hypercomputer recipes
- GKE
The post includes a full deployment guide in the comments.
More from Infra
- LifeOS: A Local, Voice-Driven Personal Organizer — Extension-Bid-639 · 2026-08-24
- Hyperscalers: Choosing Between HDD and SSD Based on Space and Cost — generativist · 2026-08-24
- Samsung shows new HBM cooling solution, hints at die performance variance — BenBajarin · 2026-08-24
- Tobi open-sources walgit: A single-binary Git server backed by object stores — jevon · 2026-08-24
- s3collections: Durable Go data structures backed directly by S3-compatible storage — andersonbcdefg · 2026-08-24
- Prediction market gives 68% chance of a state data center moratorium by year-end — Polymarket · 2026-08-24