DeepLoop debuts to make looped transformers stable and scalable, echoing 48Lx2 frontier model rumors
burny_tech · x · 2026-09-04
Yifan Zhang cites claims that some frontier models are essentially a 48-layer transformer looped twice (48L x 2), and introduces DeepLoop, a new open-source project on depth scaling for looped transformers, aimed at making the looping architecture stable and scalable.
Related event: DeepLoop: looping Transformers scale stably in depth(2 posts)→
More from Research
- Gemini Agents Crack 59-Year-Old Fusion Math Conjecture in Hours — DynamicWebPaige · 2026-10-21
- TrackEverything: CMU and Meta open-source a 3D tracker for all points in 1000+ frame videos — AdamWHarley · 2026-10-21
- Infantconnect: open-source infant brain anatomy and EEG connectivity tool from 1 to 72 months — Dr_Alex_Crimi · 2026-10-21
- Berkeley wins Schmidt Sciences HAVI grant to decode whale and parrot communication with AI — begusgasper · 2026-10-21
- Stanford CS336 Lecture 6: fused Triton kernels cut softmax memory traffic ~4x — stanfordnlp · 2026-10-21
- NVIDIA Cosmos3-H-Dreams: Generative Simulation Brings Clinical Surgery to Life — Hugging Face Blog · 2026-10-21