Looped-DiT: 260M looped model beats 6.5x larger text-to-image rival with 4.9x less compute
Apprehensive_Sky892 · reddit · 2026-10-04
Looped Diffusion Transformer (Looped-DiT) scales text-to-image models by re-running shared Transformer blocks within each denoising step, increasing compute depth without adding parameters.
Key findings:
- Naive looping fails: weak supervision across intermediate loops and unregulated attention updates erode local information.
- Deep supervision across loops plus self-modulating attention stabilizes feature updates.
- A 260M-parameter looped model surpasses a 6.5x larger baseline on multiple text-to-image benchmarks while using 4.9x less inference compute.
- Under a fixed inference budget, deeper loops yield bigger gains than more denoising steps, and deeper loops progressively correct earlier mistakes — behavior suggestive of latent reasoning.
The authors argue looped computation is a more effective scaling axis for visual generation than raw model size.
Related event: Looped-DiT: Recycled Transformer Layers Beat Models 6.5x Larger(4 posts)→
More from Multimodal
- Gemini 4 variants take three of top four spots on BrushArena image arena — teortaxesTex · 2026-11-19
- AI-Generated 'Tour of Armenia' Video With Muscular Guide Amuses Reddit — EternalSnow05 · 2026-11-19
- One image, 5x price gap: Gemini 4 Neon costs $1.01 vs GPT-6.2 Sol at $0.19 — Angaisb_ · 2026-11-19
- Creator Shares Opening Scene of '23:17', an 8-Episode AI Mystery Anime Series — SimMonzi · 2026-11-19
- Gemini 4 Neon (xhigh) demo: generating a clean Ana de Armas portrait as SVG — lyraxana · 2026-11-19
- Infinidream 0.17.2 brings 1080p Electric Sheep and screen-as-installation modes — scott_draves · 2026-11-19