GPT-6 Astra reportedly uses loop transformers — more depth, not more parameters
zephyr_z9 · x · 2026-09-15
Per SemiAnalysis, GPT-6 Astra is "basically confirmed" to use loop transformers: instead of adding parameters, the model passes through its layers multiple times, buying compute depth without growing model size. The takeaway: labs are best positioned to know which way scaling works, and this is a tell that parameter count is no longer scaling aggressively in their roadmaps.
Related event: Report: GPT-6 Astra Said to Use Loop Transformer Architecture(3 posts)→
More from Models
- 'You Can Feel the Gradient Slopes': Dev Contrasts Benchmaxxed RL Models vs General Ones — theteknosaur · 2026-11-02
- LightOnOCR-3 Launches: Tops FRBench, Adds Layout Structure and Chart Extraction — IgorCarron · 2026-11-02
- NVIDIA's Kumo Is a Family of Four Tabular Foundation Models, Not Just One — pandeyparul · 2026-11-02
- SemiAnalysis: safety classifiers are underrated — Meta's Muse tops cyber benchmark at 35.2% — ThomasScialom · 2026-11-02
- DeepSeek V4.1 Flash 1017 wins over a longtime closed-source-only user: fast, cheap, reliable — _bachrc · 2026-11-02
- Local quants vs Claude on 9 real private bugs: 3-bit costs thinking time, not score — FeydRowan · 2026-11-02