Looped-DiT: 260M looped model beats 6.5x larger ones with 4.9x less inference compute
burny_tech · x · 2026-10-04
A new paper from SenseTime, Tsinghua, NTU and collaborators proposes Looped Diffusion Transformer (Looped-DiT), an alternative scaling path for diffusion models: repeatedly running shared Transformer blocks within each denoising step to increase computational depth without growing the parameter count.
- Naive looping fails to consistently improve image quality due to weak supervision across intermediate loops and unregulated attention updates that erode local information
- The fix combines deep supervision across loops with self-modulating attention to stabilize feature updates
- Under matched-parameter and matched-compute settings, a 260M looped model surpasses a model 6.5x larger across text-to-image benchmarks while using 4.9x less inference compute
- Under a fixed inference budget, increasing loop depth yields larger gains than adding denoising steps; deeper loops progressively correct earlier mistakes, suggesting latent reasoning
The authors argue looped computation is a promising way to scale visual generation models.
Related event: Looped-DiT: Recycled Transformer Layers Beat Models 6.5x Larger(4 posts)→
More from Multimodal
- Gemini 4 variants take three of top four spots on BrushArena image arena — teortaxesTex · 2026-11-19
- AI-Generated 'Tour of Armenia' Video With Muscular Guide Amuses Reddit — EternalSnow05 · 2026-11-19
- One image, 5x price gap: Gemini 4 Neon costs $1.01 vs GPT-6.2 Sol at $0.19 — Angaisb_ · 2026-11-19
- Creator Shares Opening Scene of '23:17', an 8-Episode AI Mystery Anime Series — SimMonzi · 2026-11-19
- Gemini 4 Neon (xhigh) demo: generating a clean Ana de Armas portrait as SVG — lyraxana · 2026-11-19
- Infinidream 0.17.2 brings 1080p Electric Sheep and screen-as-installation modes — scott_draves · 2026-11-19