FireRedAudio Open-Sourced: One 9B Model That Listens, Reasons, Speaks and Edits Audio
aigclink · x · 2026-08-31
FireRedAudio is a general-purpose audio language model open-sourced by Xiaohongshu's FireRedTeam, built on a shared 9B-parameter LLM with decoupled continuous representations: an Audio Encoder pathway serves understanding while a RedAE-Patch pathway serves speech generation — claimed to be the first public design of its kind.
A single model covers ASR, audio understanding, zero-shot TTS, instruct TTS, semantic/acoustic speech editing, and accurate temporal grounding over recordings up to one hour. Official PyTorch code is available on GitHub (FireRedTeam/FireRedAudio).
Related event: Xiaohongshu Open-Sources FireRedAudio, a 9B Unified Audio-Language Model(2 posts)→
More from Multimodal
- VideoGen-Agent: An 8B Multimodal Agent Turns Video Generation Into a Tool-Use Loop — jiqizhixin · 2026-10-16
- Drama-3 weights land on the Hugging Face Hub with an official demo — Gradio · 2026-10-16
- MiniCPM-V 4.5 offer open-source local image understanding to replace paid vision APIs — heyshrutimishra · 2026-10-16
- Surreal AI-generated landscape hides "another landscape inside the measurements" — piotrbinkowski · 2026-10-16
- techhalla: Building 3D scenes in Blender is the key to AI filmmaking — techhalla · 2026-10-16
- Fan animation made in Blender with Claude Code (Opus 5.5) — Icy-Appointment3583 · 2026-10-16