The collapse is fixable: PCA projection back to teacher plus light early-step tuning restores diversity

anand_bhattad · x · 2026-11-19

The collapsed directions are recoverable: a simple PCA projects them back toward the teacher, and lightweight tuning focused on early denoising steps further restores the missing diversity.

Related event: ReDiverse Diagnoses and Fixes Diversity Collapse in Distilled Diffusion Models(9 posts)→

Original post →

More from Research

Research channel →