Report: ByteDance is Pre-training a 10T Parameter Model for Late 2024
ShakeelHashim · x · 2026-08-08
According to the Financial Times, ByteDance is currently pre-training a massive 10-trillion parameter model, which is expected to be ready before the end of the year.
This escalates previous reports that suggested they were considering a 5T parameter model. The original poster questioned where ByteDance managed to source the massive amount of compute required for such a endeavor.
Related event: Report: ByteDance is Training a 10-Trillion Parameter AI Model(18 posts)→
More from Companies & People
- OpenAI DevDay hands out Codex 'pet' collector cards, attendees show them off — gabrielchua · 2026-10-16
- ML researcher Emtiyaz Khan moves to TU Darmstadt, hiring PhD students via ELISS — EmtiyazKhan · 2026-10-16
- Tripo hosts first world-building hackathon in SF with World Labs and Runway talks — mhdfaran · 2026-10-16
- Dev warns enterprises: OpenAI and Anthropic products are an IP security risk — examachine · 2026-10-16
- a16z podcast: Can AI run the systems after writing the code? — a16z Podcast · 2026-10-16
- Zuckerberg backs electrician training school as US datacenter construction outpaces offices — emmanuelvivier · 2026-10-16