MiniMax-Music3 Integrated into Open-WebUI: Real-Time Song Generation on a Single RTX 3090

PlaidStallion · reddit · 2026-08-14

Reddit user PlaidStallion successfully integrated MiniMax-Music3 into Open-WebUI as a live tool call. Running on a single RTX 3090, the model is served via SGLang-Omni in a WSL2 Docker container, with the chat model's keepalive set to 15s to avoid VRAM contention. Users can request songs in chat and receive download links. Challenges included driver mismatches and GPU process coordination, but were resolved. The author plans to improve model loading and will open-source the code.

Original post →

More from coding & agent

coding & agent channel →