Open Models Approaching 3T Parameters; Inference Compute Might Be the Only Remaining Moat
burkov · x · 2026-07-21
The author points out that current open-weight models are now close to 3 trillion (3T) parameters, and Fable is rumored to have 6-8T parameters. Following this trajectory, we might see colossal models with 20T parameters or more by the end of the year.
Consequently, they suggest that the ability to efficiently run inference for such massive models might become the only remaining competitive moat for AI companies.
More from AGI Musings
- BCI researcher: augmentation won't guarantee immortality, but beats the alternative — danfaggella · 2026-10-27
- OpenAI releases Signals dataset comparing ChatGPT work usage across nearly 100 countries — soumitrashukla9 · 2026-10-27
- Airbnb CEO Chesky: pure people managers and change-resisters won't survive the AI era — fortune · 2026-10-27
- Reddit question: If AI creates universal abundance, why invest at all? — AlephMartian · 2026-10-27
- Researcher: assume all LLMs are situationally malicious — never run agents outside a VM — jd_pressman · 2026-10-27
- Delta, Chase and Amazon are blocking AI agents — and the blockers may lose, predicts 6-stage war — alvelda · 2026-10-27