Looped DiT: 260M model beats 6.5x larger rival on T2I benchmarks with 4.9x less compute
arankomatsuzaki · x · 2026-10-01
A new paper introduces Looped Diffusion Transformer (Looped-DiT), an alternative scaling path for text-to-image models: instead of growing parameters or denoising steps, it repeatedly runs shared Transformer blocks within each denoising step, deepening computation at fixed parameter count. Naive looping fails due to weak supervision and unregulated attention updates, so the authors add deep supervision across loops and self-modulating attention. A 260M-parameter looped model outperforms a 6.5x larger model across T2I benchmarks while using 4.9x less inference compute. Under fixed budgets, deeper loops yield larger gains than more denoising steps and can progressively correct earlier mistakes.
More from Multimodal
- Non-artist builds 14-chapter hand-painted storybook game with Fable 5.2 in 4 hours — jradoff · 2026-11-16
- Seedance-generated anime train scene stuns Reddit with cinematic quality — Ok-Solution-7889 · 2026-11-16
- AI-generated 'Men in Black' reimagined in 1977 goes viral — techhalla · 2026-11-16
- Hinglish, spoken by 350M, is the real test: Sarvam models power full voice agent pipeline — itsOmSarraf_ · 2026-11-16
- Dreamina Marketing Studio demo: turn Seedream 5.0 Pro designs into product ads in one click — socialwithaayan · 2026-11-16
- GitHub's top design skill author reveals his loop: model-as-judge until 9.2/10 — PrajwalTomar_ · 2026-11-16