EmbeddingGemma 2 multimodal scores: 67.84 visual docs, 50.67 video, 69.54 audio
tomaarsen · x · 2026-10-07
tomaarsen pulled EmbeddingGemma 2's full-precision 768d multimodal results from the model card: MMEB v2 visual documents 67.84 NDCG@5, MMEB v2 video 50.67 Hit@1, MSEB audio retrieval 69.54 MRR@10. The card also reports image and broader audio benchmarks.
More from Models
- llama.cpp ships Day-0 support for Google's EmbeddingGemma 2 — ggerganov · 2026-10-07
- Trying to Plug Open-Source Mistral Into an Agentic Coder Just Doesn't Work, Says Berman — MatthewBerman · 2026-10-07
- antirez: DeepSeek v4.1 outscores Mistral Large 4 on DeepSWE 1.1 and other benchmarks — antirez · 2026-10-07
- StartLux claims its 27B model beats Jev AI on 31 of 38 benchmarks, self-reported results — Dr_Singularity · 2026-10-07
- 24 models tested on 669 clinical decisions: Jev stays #1 as two free models close in — MaziyarPanahi · 2026-10-07
- Never run EmbeddingGemma 2 in FP16: use BF16 or FP32 to avoid NaNs — tomaarsen · 2026-10-07