Stanford's LILIE: language-informed lossless image encoder cuts T2I gFD by 14 points

jcniebles · x · 2026-10-20

Stanford researchers introduce LILIE, a Language-Informed and Lossless Image Encoder trained with language supervision to replace pixel-space loss in visual generative models. Pixel loss treats all pixels equally even though they contribute unevenly to semantics; LILIE is an invertible normalizing-flow transform trained jointly with a VLM via caption recovery from noised features. Using LILIE-space loss to train JiT models improves gFD on GPIC from 66.84 to 53.01 (14 points), and combining the losses improves further. Authors include Suchir Agarwal, Fei-Fei Li, and Jiajun Wu.

Related event: Stanford's LILIE: Language-Supervised Lossless Image Encoder Boosts Visual Generation(2 posts)→

Original post →

More from Multimodal

Multimodal channel →