U-JiT does pixel-space video generation without a VAE, hitting SOTA on Kinetics-600

LucaAmb · x · 2026-11-05

U-JiT is a video generation architecture that skips the video autoencoder entirely: it generates directly in pixel space and is trained end-to-end, achieving state-of-the-art results on Kinetics-600. The key insight is rethinking compression through the architecture itself, avoiding the compression-reconstruction tradeoff of pre-trained VAE + latent DiT pipelines.

Original post →

More from Multimodal

Multimodal channel →