Kimi K3 Estimated at 2.8T Params, Potentially Distilled from Smaller Opus
gabriberton · x · 2026-08-04
Gabriel Ribeiro discusses parameter estimation: if new estimates are accurate and Kimi K3 was distilled from Claude Opus, it would be the first time a larger model (2.8T) was distilled from a smaller one (1.1T). Revised estimates suggest Opus is around 1.1T and GPT 5.5 around 1.5T.
More from Models
- Verifying GPT Pro: Zero Math Errors, But Disastrous Exposition — josh_wills · 2026-08-04
- Ant Group Engineer's Long Post: The Four Very Different Bets of Chinese AI Labs — AcanthisittaOk1699 · 2026-08-04
- OpenAI's Upcoming 'Astra' Model to Focus on Multi-Agent Collaboration — thesaraharminta · 2026-08-04
- Testing Qwen3.8-Max: Open Models Are Catching Up with Closed Frontier — dair_ai · 2026-08-04
- Expert Replicates OpenAI Astra Math Results in 24 Hours — Gary Marcus · 2026-08-04
- Claude 3.5 Sonnet and Opus Are Remarkably Terrible at Making Slides — nathanbenaich · 2026-08-04