ByteDance Seed proposes GenFirst for end-to-end generative latent learning

jiqizhixin · x · 2026-09-02

Most latent generative models follow a two-stage recipe: training a VAE for reconstruction and freezing it before training the generative model. ByteDance Seed presents GenFirst to enable stable end-to-end latent learning, arguing that reconstruction-optimal latents are not generation-friendly. The work identifies a prior-entropy imbalance as the key cause of latent collapse. After fixing this with explicit entropy preservation, they find asymmetric learning dynamics between generation and reconstruction, leading to the "Generation Before Reconstruction" strategy.

Related event: ByteDance Seed's GenFirst: End-to-End Latent Generation Without Model Collapse(2 posts)→

Original post →

More from Multimodal

Multimodal channel →