Moonshot Allegedly Deploys k3 on H200s
TheZachMueller · x · 2026-07-19
Shared content suggests that Moonshot might be serving k3 on multi-node H200 setups, a deployment method whose throughput might underperform compared to nvfp4 b300.
The quoted section discusses how large-scale organizations utilize models:
- They might be billed by GPU hours rather than tokens;
- They can secure dedicated nodes and independent endpoints;
- Users manage their own guardrails;
- If closed-source models are 'secretly degraded,' it's hard for users to notice, whereas open-weight models allow direct verification of changes.
Overall, it compares the cost, stability, and controllability of different model deployment and provisioning methods.
Related event: Debate Over Moonshot K3 Deployment and Inference Costs(2 posts)→
More from Infra
- Anthropic S-1 reveals 48 cents of compute cost per dollar of Q2 revenue — nmasc_ · 2026-10-26
- Persistent AI joins UR network to route private AI inference with encrypted, IP-hidden traffic — 0xSammy · 2026-10-26
- Anthropic's disclosed compute commitments: $114.5B Google, $161.2B Broadcom top the list — BenBajarin · 2026-10-26
- SpaceX strikes $40B deal with Apollo Global to lease AI chips and data center hardware — Polymarket · 2026-10-26
- SpaceX AI revenue up 830%, Claude designs 318K antivenom proteins in 64 hours — PeterDiamandis · 2026-10-26
- Meta plans up to $95 billion stock sale to fund AI buildout — The Decoder · 2026-10-26