Report: ByteDance Discussing Training a 5-Trillion Parameter LLM

scaling01 · x · 2026-08-07

Reports indicate ByteDance is discussing training a massive LLM with over 5 trillion parameters. For context, Kimi K3 is currently at 2.8 trillion. ByteDance's founder is also reportedly against distilling western models, signaling a push for frontier native capabilities.

Related event: Report: ByteDance is Training a 10-Trillion Parameter AI Model(18 posts)→

Original post →

More from Companies & People

Companies & People channel →