RubatoCodec Adds Exact Utterance Budgets and Streaming Decoding to Speech Codecs

third-intelligence · hf · 2026-10-22

RubatoCodec is a variable-frame-rate speech codec built on X-Codec-2 with an exact utterance-level event budget and streaming decoding. Its Adaptive Firing mechanism splits speech into variable-duration events using codec features and energy spectra without learned thresholds, improving low-rate reconstruction and streaming TTS.

Original post →

More from Multimodal

Multimodal channel →