How it works: Gemini 4 Carbon maps bucket and rubber-band sounds to MIDI
alexanderchen · x · 2026-11-11
Implementation detail of Alexander Chen's household-sounds instrument project: videos of items around his house (with kids and cat!) were fed to Gemini 4 Argon in Antigravity, then Gemini 4 Carbon sliced the audio, found fundamental pitch via FFT + onset detection, and mapped sounds to MIDI notes playable on a keyboard. Screenshots show Everytone's sample browser with spectrograms, pitch labels (A#1, C2, etc.), and re-pitch controls.
Related event: Gemini 4 Turns Household Sounds Into Playable Instruments(2 posts)→
More from Multimodal
- Same prompt face-off: FABLE 5.2 vs Gemini 4 Argon draw an illuminated-manuscript magpie — teortaxesTex · 2026-11-11
- Can you tell which is real? AI-edited conference photo goes viral for its realism — threepointone · 2026-11-11
- Turning household sounds into instruments with Gemini 4 (FFT + onset detection) — alexanderchen · 2026-11-11
- Midjourney dual-sref combo yields whimsical storybook fantasy art — Kyrannio · 2026-11-11
- Blind judge scores Fable 5.2 at 8.4 vs Opus 5.5's 6.4 in same-prompt video showdown — nateliason · 2026-11-11
- Anime-style AI images pushed further at 4K with cinematic quality — Kyrannio · 2026-11-11