Analysis: Astra's recurrent depth could yield a 1.38x effective-parameter multiplier

scaling01 · x · 2026-09-02

Analysis of Astra's reported use of "recurrent depth" (a looped transformer): the same information passes through the same transformer layers multiple times before producing the next token, rather than a single pass through a fixed stack.

Citing another recurrent-depth paper where running the same block twice gave a 1.38x effective-parameter multiplier, the author estimates OpenAI could train a 10T recurrent-depth model performing like a 13.8T model, or 7.25T performing like 10T (multiplier plausibly 1.3-1.7).

Trade-off: pre-training compute and decode latency stay the same, but inference FLOPs and prefill latency increase.

Related event: Astra reportedly uses recurrent depth transformers, yielding 1.38x effective parameter multiplier(5 posts)→

Original post →

More from Models

Models channel →