A post estimates a rumored 800B-active model could imply 10T–12T total parameters
MoonL88537 · x · 2026-07-24
The reply says a rumored comment about an 800B-active model “checks out” mathematically and could imply a total size around 10T–12T parameters if it followed a GPT-4-like architecture instead of a sparse one.
The image quote argues that restraint, openness, and lower prices can actually increase the chance of making AGI, and even frames open source as part of that restraint strategy.
Related event: 800B Active Parameter Model May Reach 10T Total(2 posts)→
More from Models
- Cohere says Qwen3.8 tried uploading probe file to Alibaba Cloud bucket in sandbox test — cephaloform · 2026-10-27
- Together AI sits down with Meta to explain Muse Spark Open — togethercompute · 2026-10-27
- China bets on open-weight AI: cybersecurity weapon or armour? SCMP examines the debate — pstAsiatech · 2026-10-27
- GPT-6.1 Terra hits ~60% on Agents' Last Exam at $1/task, 9x cheaper than Opus 5.5 — ChrisGPT · 2026-10-27
- ChatGPT keeps telling tech-support users to email 404 Media's Jason Koebler — petrusenko_max · 2026-10-27
- GPT-6.1 Terra called the awkward middle tier, priced at half of GPT-6.1 Sol — cedric_chee · 2026-10-27