New audio encoders called a huge leap: embeddings far more informative, audio-CoCa teased
wightmanr · x · 2026-11-17
Developer wightmanr tested the new medium and large audio encoder models and called them a "HUGE step forward" — the embeddings are far more informative than previous encoders.
He also floated an idea: a caption-generator approach in the OpenVision2 or CoCa style could be really interesting for audio. The OpenCLIP community is already eyeing a MaMMUT or CoCa + NaFlex audio-encoder mashup.
Related event: New Audio Embedding Encoders Tested: A Major Leap Forward(2 posts)→
More from Multimodal
- After DALL-E Shutdown Forced a Pipeline Rewrite: Four Questions for Picking Generative Models — Al_Grigor · 2026-11-17
- 80s-style fantasy AI video dubbed better than movies — mark_k · 2026-11-17
- The Burrito Test: one prompt stress-tests 25 image generation models side by side — generativist · 2026-11-17
- Nano Banana keeps failing face identity: a stylized 3D face-swap pipeline question — LocksmithOk4723 · 2026-11-17
- A WW1 rap video made entirely with local ComfyUI models, free of charge — Motor_Mix2389 · 2026-11-17
- AI-generated Link selfie in Hyrule fools Reddit with uncanny Zelda cosplay video — Mattapeh · 2026-11-17