First open dictation benchmark: 761 recordings across 10 apps, Wispr Flow 79% vs Apple 35%
rohanpaul_ai · x · 2026-11-11
Voice Arena released the Dictation Bench, the first open benchmark of AI dictation apps—testing the real apps, not APIs. 761 recordings from 87 speakers were played into 10 apps on a Mac, with 5 LLM judges deciding if each draft could be sent as-is. Results: Wispr Flow 79%, Apple 35%. Reference policies, app configs, judge instructions, and statistical-tie flags are all published. rohanpaulai notes vendors now have something concrete to respond to, though the scope is US English on macOS only.
More from Apps
- Loom founder launches Roma 2.0, a shared to-do list that orchestrates AI agents — thetripathi58 · 2026-11-12
- AI pipeline turns a few product photos into a full video ad via storyboard-first workflow — jeffgrimes9 · 2026-11-12
- Pika Integrates Seedream 5.5: Split Images Into 100+ Layers for Precise Multi-Turn Edits — aziz4ai · 2026-11-12
- Llama app adds simultaneous voice, image and video input, running locally on LFM3-Omni — mervenoyann · 2026-11-12
- Google Labs launches Tabletop, an AI experiment that builds custom shared spaces on demand — GoogleLabs · 2026-11-12
- Adobe Illustrator's AI Assistant enters beta, taking over repetitive design work — rufusd · 2026-11-12