Diffusion Model Generates Playable Instruments, Open Source Soon

RoyalCities · reddit · 2026-07-07

Independent developer @RoyalCities shared a "fully playable AI-generated instrument" built over two months. Using a diffusion model-based text-to-keybed workflow, a single prompt generates playable instruments exportable to various sampler formats for any DAW, prioritizing timbral consistency across the keyboard over simple pitch shifting.

The author plans to open-source everything for free, later releasing in-depth technical videos covering training strategies, dataset adjustments, and engineering trade-offs for replication.

Related event: Dev Builds Open-Source Text-to-Synth AI Instrument with Diffusion Models(3 posts)→

Original post →

More from Multimodal

Multimodal channel →