ostris pre-training "Primal VAE": 1-channel latents match modern 8x VAEs via patching

ostrisai · x · 2026-10-26

AI image training tooling author ostris announced he is pre-training a new VAE concept called Primal VAE. It performs only 2x spatial downsampling to a single channel, but patching the latent by 4 yields an effective 8x compression at 16 channels — on par with most modern VAEs — without deep compression. Shared visuals show input vs. reconstruction, the latent visualization, and the difference map, with reconstruction quality looking remarkably close to the original.

Related event: ostris pretrains radical Primal VAE with 1-channel latent(2 posts)→

Original post →

More from Multimodal

Multimodal channel →