Looped-DiT: Small Model Beats 6.5x Larger Ones by Reusing Transformer Blocks
A new paper, Looped Diffusion Transformer (Looped-DiT), repeatedly reuses a shared Transformer block at each denoising step instead of stacking deeper layers. A 260M-parameter model outperforms one 6.5x larger while using 4.9x less compute.
2026-10-01 ~ 2026-10-01 · 2 related posts
- Episode 1: Looped-DiT: Small Model Beats 6.5x Larger Ones by Reusing Transformer Blocks(2026-10-01, 2 posts)
- Episode 2: Looped-DiT: Recycled Transformer Layers Beat Models 6.5x Larger(2026-10-03, 4 posts)
- Looped DiT: 260M model beats 6.5x larger rival on T2I benchmarks with 4.9x less compute — arankomatsuzaki · 2026-10-01
- Looped-DiT: 260M model beats 6.5x larger rival on text-to-image with 4.9x less inference compute — burny_tech · 2026-10-01