GPT-6 Astra reportedly uses loop transformers, adding compute depth instead of parameters
pranavmarla · x · 2026-09-16
A cited discussion around SemiAnalysis claims GPT-6 Astra (unconfirmed) uses loop transformers: instead of growing parameter count, the model passes through its layers multiple times, adding compute depth while keeping weights fixed.
- If depth beats size, the FLOP-counting arms race changes shape — inference cost curves look very different when weights are reused.
- The poster reads labs' less aggressive parameter scaling roadmaps as a signal that their own research shows diminishing returns from raw parameter growth.
- Note: this is industry rumor/hearsay, not officially confirmed.
Related event: Report: GPT-6 Astra Said to Use Loop Transformer Architecture(3 posts)→
More from Infra
- Big Tech's Future Data Center Leases Top $1.3T, 70% Added in Last Four Quarters — rohanpaul_ai · 2026-11-02
- Daniel Lemire: AI is exploding demand for boring compute, server CPUs to double — lemire · 2026-11-02
- Physical AI's real story: a 4-layer map of 15 companies behind humanoid robots — pdamodaran · 2026-11-02
- Under 5% of US consumers pay for AI, yet compute demand is already forcing usage cuts — NinaDSchick · 2026-11-02
- Sam Altman: AI query energy cost fell 1,000x-100,000x in 3-4 years — rohanpaul_ai · 2026-11-02
- Marvell and Lumentum to merge, targeting $550B AI connectivity market — BenBajarin · 2026-11-02