SpecSlot Boosts Pixel-Space Image Generation: +2.84 FID on ImageNet-512 at Lower Cost

Jiongfan Yang · hf · 2026-10-30

Researchers from Peking University, NTU and SenseTime introduce SpecSlot, a pixel-space rectified-flow transformer that decouples output detail from global attention length. Each spatial anchor is expanded into spectral slots with disjoint DCT bands; only the lowest-frequency slot joins global attention while all slots interact locally, adding spectral detail without a longer sequence. On ImageNet-512 it improves FID by 2.84 over a FLOPs-matched control with 3.9% fewer FLOPs, sits within 0.69 FID of JiT-B/16 at 38.2% lower cost, and beats JiT-B/8 on DPG-Bench by 1.06 for text-to-image at 40.6% lower forward cost.

Original post →

More from Multimodal

Multimodal channel →