Turning household sounds into instruments with Gemini 4 (FFT + onset detection)
alexanderchen · x · 2026-11-11
Developer Alexander Chen built a prototype that turns everyday household sounds (rubber bands, buckets, glasses) into playable instruments using Gemini 4 Argon/Carbon. Videos shot around his house were fed to the model; Gemini 4 Carbon extracted fundamental pitch via FFT + onset detection and mapped sounds to MIDI notes playable on a keyboard. The recording environment was built in Antigravity with live spectrograms, and a playable prototype is shared on Everytone.
Related event: Gemini 4 Turns Household Sounds Into Playable Instruments(2 posts)→
More from Fun
- Workshop moment: user tells coding agent 'you jsut fo it i odnt care' — bushibuilds · 2026-11-11
- "Human in the loop" at AI agent workshop: "just do it, I don't care" — TejasKumar_ · 2026-11-11
- The Bullshit Index Index: 8 frontier models ranked by making up an AI capability index — Jealous-Two-4436 · 2026-11-11
- The 'Boeing Bench': AI models race to build a Boeing 747, Fable 5.2 beats Gemini 4 Carbon — victormustar · 2026-11-11
- The 'They don't know a benchmark number went up' meme hits r/LocalLLaMA — onil_gova · 2026-11-11
- Asking Opus to remove one thing yields 4,000 lines of tests and a 19,000-word psychological novel — jh3yy · 2026-11-11