Report: ByteDance Pre-training Massive Model Nearing 10T Parameters
zijing_wu · x · 2026-08-07
According to Zijing Wu, ByteDance is targeting a mega AI model nearing 10 trillion (10T) parameters in the early stage of pre-training, aiming to compete with Anthropic's estimated 8T parameter Mythos model.
Additionally, multiple Chinese labs are training models around 5T parameters (e.g., Fable est. 5T), while Seed has been pursuing a no-distillation approach for over a year.
Related event: Report: ByteDance is Training a 10-Trillion Parameter AI Model(18 posts)→
More from Models
- Users report Gemini's memories can't actually be deleted even after wiping chat history — ThrowRA_Purpose2025 · 2026-10-16
- OpenAI stealth-testing mysterious internal model 'Aeon' in Codex desktop app and Dots — cedric_chee · 2026-10-16
- Argon edges out astra as daily driver, but Claude still wins heavy coding work — iruletheworldmo · 2026-10-16
- NVIDIA ships FP4-quantized Qwen3.8-Flash for local use, trending on Hugging Face — nvidia · 2026-10-16
- RoboVista benchmark: Gemini-4 Argon hits 81.9% on robotics understanding — berkeley_ai · 2026-10-16
- Dev reports decision model jev beats gpt-6-luna on quality in real training pipeline — genmon · 2026-10-16