Teaching Claude to 'listen' to songs with log-scaled spectrograms and pitch-colored waveforms
vzakharov · reddit · 2026-10-10
A developer shares an experiment in getting Claude to "understand" music visually: converting songs into log-scaled spectrograms (less song-relevant info lives in the high end of the spectrum, so it's compressed) and waveforms colored by dominant pitch, with bass and treble handled separately.
The goal is at-a-glance musical understanding through images, and the author is soliciting further visualization ideas from the community — an unconventional multimodal use of LLMs.
More from Multimodal
- MiniMax-H3 hailed as favorite open release of the year, runs fully local — AdinaYakup · 2026-10-23
- Michal Malewicz experiments with depth maps in his creative workflow — michalmalewicz · 2026-10-23
- One-Shot Tunable Style Transfer on Flux3 Via Reference Latent + Node — Winter_unmuted · 2026-10-23
- PhysVidBench accepted at EMNLP 2026: do video gen models grasp physical commonsense? — aykuterdemml · 2026-10-23
- EMNLP 2026 paper teaches multimodal LLMs to get cartoons via incongruity-resolution supervision — aykuterdemml · 2026-10-23
- A gorgeous Midjourney style: sref code 820221253 for dreamy lavender watercolor looks — umesh_ai · 2026-10-23