Creative demo: your daily voice note becomes an AI-painted canvas with a matching melody
iamrobotbear · x · 2026-09-22
A developer built a small app with Jev: you talk about your day, Gemini transcribes the audio, Jev parses the text for cues across 12 colors linked to emotions, then Claude-generated JavaScript paints an abstract canvas backed by a Tone.js MIDI melody—words become a painting, and the painting becomes music.
Stack: Jev for color + emotion inference via @typesafeai, Gemini for transcription, Claude for the painting code, ChatGPT for front-end UI refinement.
More from Multimodal
- Runway demos model that redesigns objects to fit new scene dimensions — _AustinCalvert_ · 2026-09-22
- Pexo Launches AI Video Agent That Lets You 'Vibe-Create' Videos via Chat — aftahi_ai · 2026-09-22
- A 27B model one-shot recreates 618 visual styles as SVG artworks, text-only — Seromelhor · 2026-09-22
- Runway Shows Video Model Understanding Scenes in 3D, Not Flat Layouts — tlakomy · 2026-09-22
- Neuralink's brain-to-voice ALS demo hits 5.4M views in 2 days, powered by Grok Voice — alvelda · 2026-09-22
- VRAM vs Blackwell Speed: 3090 Ti or 5080 for Local Video Generation? — Apollorax · 2026-09-22