ByteDance Reportedly Pre-Training 10-Trillion Parameter AI Model, Far Exceeding Kimi K3
rohanpaul_ai · x · 2026-08-07
According to the Financial Times, ByteDance is currently pre-training an AI model with up to 10 trillion parameters, significantly exceeding the 2.8 trillion parameter size of Kimi K3.
The report also notes that ByteDance has avoided distilling rival models for over a year, preferring independent model development. If this reported run succeeds, it will demonstrate ByteDance's ability to execute frontier-scale pretraining without leaning on a competitor's model as a teacher.
Related event: Report: ByteDance is Training a 10-Trillion Parameter AI Model(18 posts)→
More from Companies & People
- ML researcher Emtiyaz Khan moves to TU Darmstadt, hiring PhD students via ELISS — EmtiyazKhan · 2026-10-16
- Tripo hosts first world-building hackathon in SF with World Labs and Runway talks — mhdfaran · 2026-10-16
- Dev warns enterprises: OpenAI and Anthropic products are an IP security risk — examachine · 2026-10-16
- a16z podcast: Can AI run the systems after writing the code? — a16z Podcast · 2026-10-16
- Zuckerberg backs electrician training school as US datacenter construction outpaces offices — emmanuelvivier · 2026-10-16
- awesome-ai-engineering: a free GitHub repo packing the full AI engineering learning path — bigaiguy · 2026-10-16