DeepLoop: looping Transformers scale stably in depth

Yifan Zhang released DeepLoop, a new paper on stably scaling depth in recurrent Transformers, noting rumors that some frontier models are essentially 48-layer transformers looped twice.

2026-09-03 ~ 2026-09-04 · 2 related posts