Hands-Free Music Creation App Demo

jxnlco · x · 2026-07-11

The shared content showcases an early-stage demo of a **hands-free music creation app**, which the author built while testing GPT-5.6 Sol. ### Key Capabilities - Runs on macOS, built with **Swift + C++**. - Capable of editing **MIDI, audio, video, sheet music, tempo, time signatures, and harmony layers**. - Operates via collaboration between **gpt-realtime-2.1, Whisper, and Codex App Server**. - Can currently execute **300+ actions**. ### Use Case - The author describes the experience as akin to "working with an audio engineer in a recording studio." - An **iOS companion app** was also developed to remotely connect to the home studio computer while keeping voice mode active. The author plans to share more demos in the coming week.

Original post →

More from Multimodal

Multimodal channel →