Asuka-FM: 206M dual-stream DiT pretrained on one RTX 4090 in 160h for under $55

bdsqlsz · x · 2026-11-20

A new arXiv paper, Asuka-FM, presents a system-architectural co-design framework for text-to-image pretraining on consumer hardware: a 206M-parameter dual-stream DiT pretrained from scratch on a single RTX 4090 (24GB) in 160 GPU-hours for under $55 at 512px, reaching 0.609 GenEval and 78.51 DPG-Bench — Pareto-optimal DPG at just 0.066×10²¹ FLOPs of denoiser training compute.

Key designs targeting single-GPU bottlenecks:

The charts show Asuka matching MiniT2I-family DPG scores with roughly an order of magnitude less compute, positioning it as an accessible foundation-modeling baseline for academic labs.

Original post →

More from Multimodal

Multimodal channel →