ByteDance Reportedly Training 10T Parameter Model; Chamath Points Out Lack of Distillation
markjeffrey · x · 2026-08-07
According to the Financial Times (FT), ByteDance is currently in the pre-training stage of a model with up to 10 trillion parameters, approaching a mythical scale. Investor Chamath retweeted the news, noting that if reports are accurate and it uses zero distillation to jumpstart, it proves that many things are more 'value destructive than value accretive'.
Related event: Report: ByteDance is Training a 10-Trillion Parameter AI Model(18 posts)→
More from Models
- OpenAI stealth-testing mysterious internal model 'Aeon' in Codex desktop app and Dots — cedric_chee · 2026-10-16
- Argon edges out astra as daily driver, but Claude still wins heavy coding work — iruletheworldmo · 2026-10-16
- NVIDIA ships FP4-quantized Qwen3.8-Flash for local use, trending on Hugging Face — nvidia · 2026-10-16
- RoboVista benchmark: Gemini-4 Argon hits 81.9% on robotics understanding — berkeley_ai · 2026-10-16
- Dev reports decision model jev beats gpt-6-luna on quality in real training pipeline — genmon · 2026-10-16
- Google won't publish Argon 4 limits in AI Pro—users compare experiences — Consistent-Text-2662 · 2026-10-16