StepFun's StepAudio 3 Realtime reasons while speaking, hits 90.6 on MMSU
stepfun-ai · hf · 2026-09-16
StepFun released the technical report for StepAudio 3 Realtime, an audio-language foundation model built around a continuous listen-converse-think-act loop.
- Deep Perception captures acoustic cues to interpret user intent
- Seamless Duplex models synchronized audio streams to handle pauses, backchannels, and interruptions
- Think-While-Speaking runs private reasoning in parallel with spoken delivery, resolving the deliberation-vs-latency tradeoff
- An integrated Voice Agent executes tools asynchronously without disrupting dialogue
In reasoning mode it scores 73.0 macro on StepAudioChat, 90.6 on MMSU, 98.9 Overall on the Artificial Analysis Full-Duplex Bench, and 56.0% task success on τ-Voice — matching dedicated reasoning models while speaking in real time.
Related event: StepFun Releases Five StepAudio 3 Models Covering Full Audio AI Stack(6 posts)→
More from Models
- Open-source VoxLock tops Krisp voice isolation benchmark with 4.95% WER — Arbaz Siddiqui · 2026-11-02
- Anthropic's 85% inference margin sparks debate on open source's price-pressuring role — code_star · 2026-11-02
- User reports xAI appears to have quietly raised weekly usage limits, dropping his meter from 93% to 47% — XFreeze · 2026-11-02
- Meituan's LongCat-2.5 lands as 1.6T MoE agent model, with DeepSeek copycat speculation — teortaxesTex · 2026-11-02
- Asked what AI firms want you to stop owning, Claude said: your own compute — alex_verem · 2026-11-02
- Is Hermes Still Worth It? Codex's $200 Tier Now Overlaps Most of Its Value — Foreign_Lead_3582 · 2026-11-02