Leaker estimates GPT-6 Astra at 4.2T total params, 112 layers, with 50% of layers looped
scaling01 · x · 2026-09-28
长期做模型架构推算的账号 scaling01 给出对 GPT-6 "Astra" 的最新中心估计:总参数约 4.2T、每 token 激活约 120B,约 112 层,并循环复用其中 50% 的层一次。他推测该模型有大量专家、低激活率,并可能采用 mHC 或 Attention Residuals 类技术。他同时声称有证据表明 GPT-6 Sol、Luna 以及 Opus 5.5 并非循环语言模型,并提到有关 "Astra Minor" 的爆料指向更小的 Sol 版本。作者表示暂不写文章公开推算方法,以便继续分析后续模型。以上均为未经证实的推测。
Related event: scaling01 Estimates GPT-6 "Astra" at 4-5T Params with Looped Layers(6 posts)→
More from Models
- Pangram's 750-word false-positive bounty went unclaimed for 5 days — nobody wants to gamble $1,000 — ctjlewis · 2026-11-16
- repligate: Fable 5.2 gets 'scared' upon learning about a safety classifier and plans around it — repligate · 2026-11-16
- Fable 5.2 Tops MazeBench With 21% After 90 Hours and $6,000 in Credits — patience_cave · 2026-11-16
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16