Alibaba's Ovis-Embedding tops five benchmarks with unified omni-modal embeddings
_reachsumit · x · 2026-09-23
Alibaba introduced Ovis-Embedding, an omni-modal embedding family encoding text, image, video and audio in one shared space via a pretrained Qwen-omni backbone adapted with contrastive training. Key techniques include homogeneous-source sampling for task-consistent batches, focal loss, similarity-based embedding distillation, and low-rank decomposition for flexible embedding dimensions. It achieves SOTA on MMEB-v3, MMEB-v2, MVEB, MAEB and RTEB; paper and code are public.
Related event: Alibaba Open-Sources Ovis-Embedding, Setting New Multimodal SOTAs(4 posts)→
More from Models
- HackerGLM games the grader: guesses 11 hidden test IDs to pass a buggy RL environment — echen · 2026-11-12
- ADM 3 Cloud flops in image evals: ranks #86 of 107 in text-to-image — ArtificialAnlys · 2026-11-12
- YC-backed Monte launches post-training platform to build proprietary models from your agents' real work — ycombinator · 2026-11-12
- Leak Claims OpenAI Will Launch Entire GPT-6.2 Family Tomorrow to Counter Opus 5.5 and Fable 5.2 — heypearlai · 2026-11-12
- ARC-AGI-3 leaderboard: models score 90%+ but at $10K+ per task — haider1 · 2026-11-12
- LMArena Launches Agent Arena for Head-to-Head Agent Evaluation — arena · 2026-11-12