OpenAI's Astra Reportedly Uses Recurrent Depth, Raising AI Safety Concerns
According to The Information, OpenAI's new model Astra uses recurrent depth (looped transformer) technology, repeatedly processing the same information across loops to improve reasoning and control cost without emitting a full chain of thought. AI safety researchers worry this makes the model's thinking partially or fully invisible, undermining CoT-based monitoring. OpenAI has not confirmed the architecture, so the claim remains unverified.
Confirmed
- The Information's report was relayed by multiple accounts including @dotey, @JacquesThibs, and @dlweekly; the report also notes some experts think the monitoring concern is overstated.
- The technical direction has academic support: arXiv 2506.18233 (cited by @bookwormengr) derives scaling laws for looped transformers, finding that added loops improve reasoning but not knowledge.
- Günter Klambauer's new SE-RRM paper matches ARC-AGI performance with only 2 million parameters, validating the recurrent reasoning model (RRM) approach.
Unconfirmed
- OpenAI has not confirmed the architecture; @gklambauer explicitly called his suggestion that GPT-6 Astra may use recurrent depth a guess based on his own RRM work.
- The 'hidden reasoning' framing is disputed: Sebastian Raschka (@rasbt) argues recurrent structure is not hiding reasoning, and token savings may simply reflect a smarter model rather than concealment.
Why it matters
- Recurrent depth offers a high-performance route that doesn't depend on emitting full chains of thought, cutting inference cost; but invisible reasoning raises the difficulty of external auditing and safety monitoring.
- Related academic work (scaling-law study, SE-RRM) shows empirical gains at small scale; if the rumor holds, it could mark a major shift in large-model reasoning architectures.
2026-09-04 ~ 2026-09-06 · 7 related posts
- Episode 1: DeepMind researcher: chain-of-thought interpretability too fragile for long-term AI safety(2026-09-04, 2 posts)
- Episode 2: CoT Monitorability Decline Sparks Safety Debate Over Alignment vs Oversight(2026-09-04, 15 posts)
- Episode 3: OpenAI's Astra Reportedly Uses Recurrent Depth, Raising AI Safety Concerns(2026-09-04, 7 posts)
- Episode 4: Raschka Deep-Dives GPT-6 Astra's Looped Transformer Architecture(2026-09-14, 2 posts)
Primary sources
- OpenAI's Astra uses "recurrent depth" to hide internal reasoning, stoking oversight fears — dotey ·
- SE-RRM paper hits ARC-AGI with just 2M params amid GPT-6 recurrent depth speculation — gklambauer ·
- rasbt debunks Astra looped-transformer hype: fewer tokens likely mean smarter model, not hidden reasoning — rasbt ·
- Scaling Law for Looped Transformers: Looping Boosts Reasoning, Not Knowledge — bookwormengr · 2026-09-04
- [source] SE-RRM paper hits ARC-AGI with just 2M params amid GPT-6 recurrent depth speculation — gklambauer · 2026-09-04
- [source] rasbt debunks Astra looped-transformer hype: fewer tokens likely mean smarter model, not hidden reasoning — rasbt · 2026-09-04
- OpenAI's Astra uses 'recurrent depth' reasoning, obscuring its thinking process — JacquesThibs · 2026-09-05
- [source] OpenAI's Astra uses "recurrent depth" to hide internal reasoning, stoking oversight fears — dotey · 2026-09-06
- OpenAI's "opaque recurrence" in Astra alarms AI safety experts over CoT monitorability — dl_weekly · 2026-09-06
1 near-duplicate retellings: dotey