800B Active Parameter Model May Reach 10T Total

Developers estimate that a rumored model with 800 billion active parameters could have up to 10 to 12 trillion total parameters if it uses a GPT-4-like dense architecture rather than a sparse one.

2026-07-24 ~ 2026-07-24 · 2 related posts

• Estimating 800B Active Param Model: 10T Total Params if GPT-4 Style — _xjdr · 2026-07-24
• A post estimates a rumored 800B-active model could imply 10T–12T total parameters — MoonL88537 · 2026-07-24