Rumor: Frontier Models May Be 48-Layer Transformers Looped Twice; DeepLoop Paper Explores Depth Scaling
dotey · x · 2026-09-06
- A circulating rumor (unverified) says some frontier models are essentially a 48-layer transformer looped twice (48L × 2); Chinese AI circles speculate OpenAI loops twice and ByteDance four times.
- The accompanying DeepLoop paper (Depth Scaling for Looped Transformers) presents methods to make looped transformers stable and scalable.
- If true, looped architectures would reshape assumptions about frontier parameter efficiency.
More from Models
- 105 Real Bugs Tested: GPT-6.1 Sol Over 10x Cheaper Than GPT-5.6 Sol — PawelHuryn · 2026-10-23
- Abliterated V4.1-Flash eval: abstract algebra drops 6pp but college math gains 5pp — teortaxesTex · 2026-10-23
- Claude users hit "model at capacity" errors hourly, canceling plans over it — Alex-Stack · 2026-10-23
- Kimi K3.1 launch imminent: 3T-param bet on RL seen as make-or-break — teortaxesTex · 2026-10-23
- Uncensored fine-tunes vanish from Hugging Face amid unexplained takedowns — umarmnaq · 2026-10-23
- Claude app menu leaks mystery model name 'Fable' as user hits limits — ezshine · 2026-10-23