Ant's LLaDA-Image Goes Open Source: 90% Text-Free Pretraining Tops Open-Source T2I Charts
机器之心 · wechat · 2026-09-07
InclusionAI has released and fully open-sourced LLaDA-Image, a unified text-to-image and instruction-editing model built on a from-scratch 6B single-stream DiT paired with the LLaDA2.0-mini diffusion LM for understanding.
Key method: "learn to draw before learning to listen"
- Over 90% of 220M cumulative generation training samples use image-only supervision: pretraining skips captions entirely, with masked-image completion providing both condition and target to build visual priors; image-text pairs are reserved for later SFT language alignment.
- Six-stage pipeline from CoT SFT of the understanding backbone through pure-image pretraining, text alignment, unified T2I/I2I training, and TwinFlow distillation.
- Engineering details: affine-free RMSNorm across the DiT fixes long-run training scale drift; Muon optimizer; TwinFlow shares one DiT backbone for generator and fake-score roles, cutting inference from 50 steps to 2-4.
Results: 53.53/53.38 on Qwen-Image-Bench (EN/ZH), first among open-source models and between GPT-Image 1 and Imagen 4.0 Ultra; strong long-text rendering (0.923/0.913) and editing scores (7.336/7.294 on GEdit-Bench). Counting (GenEval 0.53) remains a weakness.
Weights (incl. FP8 and Turbo), training/inference code, and the full data recipe are open on GitHub, Hugging Face, and ModelScope.
More from Multimodal
- Sheet Music to MIDI Pipeline Offers a More Structured Space for Music Models Than Audio — felpix_ · 2026-09-07
- Seen2Scene open-sourced: flow matching trained on real partial scans for 3D scene completion, ECCV 2026 — angelaqdai · 2026-09-07
- TAIKEN: a 4-minute AI action film made with MiniMax H3 and ChatGPT — bennash · 2026-09-07
- Midjourney watercolour-style generations showcased — davidhoang · 2026-09-07
- Wuxia "Netherworld Divine Palm" AI video made with open-source MiniMax H3, prompt shared — Low_Loquat_4035 · 2026-09-07
- ComfyUI-Easy-Use adds Pass or None node for conditional value routing in workflows — altoiddealer · 2026-09-07