Leaker: GPT-6 at ~3T params would need 2-3x layer looping to stay plausible
scaling01 · x · 2026-09-28
- Follow-up to scaling01's GPT-6 Astra size estimates: if the model is much smaller (3T total params), its layers would likely loop 2-3 times.
- Otherwise, the configuration would imply a wildly implausible 2% active ratio.
- Unverified speculation, same thread as the main estimate.
Related event: Leaker estimates GPT-6 'Astra' as 4.2T-parameter looped language model(5 posts)→
More from Models
- Apple dictation users report recent quality regression with random word errors — whatsallthiss · 2026-09-28
- TypeSafe AI's Jev returns confidence-scored decisions, not text: a16z sits down with Diogo Almeida — a16z · 2026-09-28
- Zvi jokes Opus 5.5 totally missed an obscure cultural reference while editing his blog — TheZvi · 2026-09-28
- Meta recaps 6 months of launches: 10 Muse releases plus Meta Model API — AIatMeta · 2026-09-28
- Vercel CEO: open models now drive 80% of Vercel's token traffic as OpenAI, Gemini, Anthropic lose ground — RihardJarc · 2026-09-28
- Real-time robot control showdown: GPT-6 Astra vs Opus 5.5 vs Grok 4.7 vs MolmoAct2 — DJiafei · 2026-09-28