A post estimates a rumored 800B-active model could imply 10T–12T total parameters

MoonL88537 · x · 2026-07-24

The reply says a rumored comment about an 800B-active model “checks out” mathematically and could imply a total size around 10T–12T parameters if it followed a GPT-4-like architecture instead of a sparse one.

The image quote argues that restraint, openness, and lower prices can actually increase the chance of making AGI, and even frames open source as part of that restraint strategy.

Related event: 800B Active Parameter Model May Reach 10T Total(2 posts)→

Original post →

More from Models

Models channel →