EmbeddingGemma 2 code retrieval jumps 14%, multilingual gains marginal over v1
tomaarsen · x · 2026-10-07
EmbeddingGemma 2 supports 100+ languages with MTEB multilingual v2 at 61.36 vs 61.15 for EmbeddingGemma 1 — a marginal gain. The bigger improvement is code: MTEB code v1 goes from 68.76 to 78.68, roughly a 14% relative lift. All scores from the model card at 768d.
More from Models
- llama.cpp ships Day-0 support for Google's EmbeddingGemma 2 — ggerganov · 2026-10-07
- Trying to Plug Open-Source Mistral Into an Agentic Coder Just Doesn't Work, Says Berman — MatthewBerman · 2026-10-07
- antirez: DeepSeek v4.1 outscores Mistral Large 4 on DeepSWE 1.1 and other benchmarks — antirez · 2026-10-07
- StartLux claims its 27B model beats Jev AI on 31 of 38 benchmarks, self-reported results — Dr_Singularity · 2026-10-07
- 24 models tested on 669 clinical decisions: Jev stays #1 as two free models close in — MaziyarPanahi · 2026-10-07
- Never run EmbeddingGemma 2 in FP16: use BF16 or FP32 to avoid NaNs — tomaarsen · 2026-10-07