ReDiverse: probing how distilled diffusion models collapse diversity in early denoising layers
anand_bhattad · x · 2026-11-19
Researcher anandbhattad unveiled ReDiverse, applying his probe→analyze→improve methodology to boost diversity in distilled generators.
The team probed activations of several distilled diffusion models across images and videos and found a consistent pattern: a collapse in the model's principal directions, concentrated in one layer and especially early in the denoising process. Compared to the teacher model, the distilled model loses diversity in a very specific way, which the work then targets for improvement.
More from Multimodal
- Genie 4 arrives in Project Genie with native audio, real-time editing and a creation agent — GoogleDeepMind · 2026-11-19
- Sora-generated 'waiting for GTA VI' meme video takes off on Reddit — __arex__ · 2026-11-19
- CapCut + Seedance workflow: AI Extend and timeline edits for Black Friday ads — HeyNayeem · 2026-11-19
- Building snowy product reveals from a reference image with AI video tools — HeyNayeem · 2026-11-19
- Seedance 2.5 4K video generation goes global in CapCut PC, 90% off first month — HeyNayeem · 2026-11-19
- AI-generated Shakespeare vs Dostoevsky rap battle stuns with realistic visuals — madebyprospero · 2026-11-19