Luma AI Releases Abra: Diffusion Models Need 10x More Data than LLMs for Scaling
iScienceLuvr · x · 2026-08-19
Luma AI released "Abra: Scaling Diffusion Image Training," a comprehensive scaling laws study for text-to-image diffusion models. The study uses a controlled family of flow-matching transformers trained across three orders of magnitude of compute (10^19 to 10^22 FLOPs).
Key Findings:
- Diffusion models scale just as predictably as language models.
- However, they require far more data to train optimally.
- Compute optimality occurs at approximately 200 image tokens per parameter, which is ten times the Chinchilla compute-optimal prescription for LLMs.
Related event: Luma AI Publishes Scaling Laws for Text-to-Image Diffusion Models(3 posts)→
More from Multimodal
- MLP-Splatting (ECCV 2026) code released: MLPs as light-field primitives instead of Gaussians — AjdDavison · 2026-10-16
- Digital human Fae codes her own facial expressions frame-by-frame with Claude Opus 5.5 and FACS — repligate · 2026-10-16
- Meta's Omnilingual ASR, covering 1,600 languages, named a TIME Best Invention of 2026 — AIatMeta · 2026-10-16
- ATAS: Zhejiang-led team builds world-state memory framework for consistent agentic video generation — CSProfKGD · 2026-10-16
- Flux 3 Klein's Default Templates Are Broken Without Its Prompt Upscaler — StrictMove5839 · 2026-10-16
- Kroma Touted as the Most Well-Rounded Image Model Yet on Civitai — Different_Fix_2217 · 2026-10-16