Estimating 800B Active Param Model: 10T Total Params if GPT-4 Style
_xjdr · x · 2026-07-24
Addressing rumors of an 800B active parameter model, developer @xjdr performed back-of-the-napkin calculations.
He suggests that if the model shares an architecture similar to the rumored GPT-4 rather than the DeepSeek-V3 sparse architecture, its total parameter count would be around 10 to 12 trillion. He notes that while unconfirmed, the source is typically well-informed and the math is sound.
Related event: 800B Active Parameter Model May Reach 10T Total(2 posts)→
More from Models
- A technical AI crash course covers LLMs, MCP, agents, skills, and RAG — aakashgupta · 2026-07-24
- Frustrated Developer Slams AI Models for Ignoring Explicit Instructions — Unnamed-3891 · 2026-07-24
- Gemini 3.5 Flash can build a faithful Minecraft clone — majidmanzarpour · 2026-07-24
- ChatGPT’s public checkout config exposes a new Business ProLite plan — btibor91 · 2026-07-24
- GLM-5.2’s blog hints Z.ai dropped GRPO and went back to PPO — bycloud · 2026-07-24
- Kimi-k3 lands 1 point behind fable-5 on EQBench and tops writing tests — karminski3 · 2026-07-24