Neuphonic open-sources NeuDecide: a 43MB audio-to-tool-call model that runs on one CPU thread
TeamNeuphonic · reddit · 2026-10-08
Neuphonic open-sourced NeuDecide under Apache 2.0: a 43MB model that maps audio plus tool definitions directly to tool calls with arguments, skipping transcription entirely.
Performance
- 72.4% tool accuracy on SLURP's tool-only task with 10 tools — roughly 3x Nvidia Parakeet + Google FunctionGemma (24.4%) and 3.5x Cactus (20.7%)
- Single CPU thread: 46ms time-to-call and 149MB peak RAM on MacBook Pro M3; 206ms/146MB on Raspberry Pi 5
Architecture: three ONNX graphs — an audio encoder, a tool encoder combining audio representations with tokenized JSON tool definitions, and a decoder generating call tokens with KV caching. Tool lists are per-request inputs, so changing tools needs no retraining. Born from robotics voice-control work; ships with a browser WASM demo (vacuum, car, smart-home presets plus custom tools) and a Python package.
More from coding & agent
- Agent multiplexer tips: vote on responses and let a sweep task learn from them — jasonkneen · 2026-10-08
- Grok monitors X feedback and auto-files bugs — 'the loop is complete' — RachelVT42 · 2026-10-08
- Moyai, open-source cloud coding agent, cuts Devin bills 79% from $101,872 to $21,700 — tristanbob · 2026-10-08
- Pi coding agent gets an auto-mode plugin that locally classifies risky shell commands — deepu105 · 2026-10-08
- Matt Pocock shares /wait-what prompt to surface an agent's scattered questions — mattpocockuk · 2026-10-08
- Claude Projects quietly adds scheduled tasks for automated recurring runs — ColleenMBrady · 2026-10-08