Audio researcher turns his new song into an AI music game with hand-drawn cars
jordiponsdotme · x · 2026-10-05
Audio AI researcher Jordi Pons transformed his self-produced song into an arcade-style music game exploring "active listening": gameplay actions reshape the soundtrack, sound effects, and AI-generated sound textures in real time, telling the story of a dying chicken — with visuals from cars he and his wife drew for their kid.
- The song itself is fully human-made (vocals, guitar, synths) — no AI composition
- AI was used for sound design (Stable Audio generates individual triggered samples) and to build the interactive game
- His thesis: music consumption is passive; games are built around participation, making them a natural bridge to active listening
- Playable online; full write-up on his Substack "Art in Tech"
More from Multimodal
- Ego2Act benchmark tests 6 SOTA video models on goal-directed action execution — mohitban47 · 2026-10-05
- NihonSub: Open-Source Real-Time Anime Subtitle Engine Built on Whisper + DeepSeek — Grand_Marionberry115 · 2026-10-05
- RAT KING: A Character Consistency Test of MiniMax H3 — malcolmrey · 2026-10-05
- ElevenLabs launches The Search, a $100K contest to find the world's catchiest ad jingle — lukeharries · 2026-10-05
- Runway Teases Behind-the-Scenes of Jon Wertheim's New 60 Minutes Title Sequence — c_valenzuelab · 2026-10-05
- Donut Breakfast Ad Made With Google's Omni Video Model, Prompt Shared — michaelrabone · 2026-10-05