Ostris pre-trains "Primal VAE": 2x spatial downsampling to a single channel

Crazy-Repeat-2006 · reddit · 2026-10-26

Ostris is pre-training a new VAE concept called Primal VAE: only 2x spatial downsampling down to 1 channel. Patching the latent by 4 yields 8x at 16 channels — equivalent to most modern VAEs — without deep compression. Shared reconstruction samples look close to the input; the approach could reshape how image-generation models compress latents.

Related event: Ostris Pretrains Primal VAE, a Radical Single-Channel Approach(3 posts)→

Original post →

More from Multimodal

Multimodal channel →