Microsoft shrinks VibeVoice-ASR to 1.58 GB for edge-CPU real-time speech recognition
Balance- · reddit · 2026-07-28
Microsoft’s VibeVoice-ASR-BitNet is a compressed variant of VibeVoice-ASR aimed at real-time inference on edge CPUs.
- Uses heterogeneous quantization to shrink the model from 4.62 GB to 1.58 GB.
- Claims 1.6–2.3× faster inference than Whisper.cpp.
- Runs with real-time capability (RTF < 1) on as few as 3 CPU threads.
- The post frames it as a practical on-device speech recognition option with no GPU required.
More from Multimodal
- Microsoft removes Mage Flow and points to a more efficient Qwen-VL-class encoder — Dante_77A · 2026-07-29
- Opus 5 users are building full games, FPS prototypes, and 3D scenes in one shot — eyishazyer · 2026-07-29
- Seedance 2.0 prompt turns text-to-video into a chaotic bodycam street scene — techhalla · 2026-07-29
- A burger-cooking AI demo splits viewers between detail accuracy and ad-like polish — victor_explore · 2026-07-29
- SCAIL 2 survives character swaps, object permanence, and physics tests better than expected — blackmixture · 2026-07-29
- a16z’s Justine Moore says AI micro-dramas could widen who gets to create — a16z Podcast · 2026-07-29