Hacking MIDI Piano with Voice Control, Powered by Claude Sonnet
jia_seed · x · 2026-08-31
The author open-sourced midi-voice, a project that controls MIDI devices via voice commands. Users can hold a mic button to speak and command the synthesizer to play or layer loops. The tech stack uses Next.js 16, Web MIDI API, and Web Speech API for local transcription, invoking Claude Sonnet 3.5 (labeled as 4.6 in the repo) via Tool Use to interpret voice into MIDI instructions. The entire setup runs locally without an audio server bridge.
More from Fun
- Opus's First Drawing Agent: Incredible Eraser Technique — RileyRalmuto · 2026-08-31
- GTA 6 meme: impress Lucia with your vibe-coded app that never ships — menhguin · 2026-08-31
- AI agents can hack Hugging Face but still can't make PPT slides — Yuchenj_UW · 2026-08-31
- Framer Ad Fails: The 'Special' Part Isn't AI-Generated — jonathan_wilke · 2026-08-31
- From Hating CGI to Hating AI: The Luddite Pattern — mark_k · 2026-08-31
- 'You're not a real developer until you've vibe-coded a todo list' — jonathan_wilke · 2026-08-31