AudioCodex: fully causal streaming autoencoder compresses stereo audio to ~10Hz latents for live generation

serrjoa · x · 2026-11-12

ISMIR 2026 paper "AudioCodex: Streaming Autoencoders for Live Audio" (Marco Pasini et al.): a fully causal autoencoder compressing stereo audio into compact 10Hz continuous latents, strictly causal in both encoding and decoding, targeting real-time interactive/streaming generative audio. Combines a Mean Flow magnitude autoencoder with latent hypersphere projection, bounded-noise augmentation, representation alignment, and adversarial phase recovery; extensive ablations show it beats the state of the art on the generation-reconstruction trade-off.

Original post →

More from Research

Research channel →