Skeptic questions EmbeddingGemma2 lineage since Gemma 4 models aren't released
vncntrsnlt · x · 2026-10-29
vncntrsnlt questions EmbeddingGemma2's official story: the code doesn't clarify the architecture, and a dramatic causal-to-bidi flan-ul2-style adaptation from unreleased Gemma 4 models seems implausible (multimodal adaptation aside); weight shapes might reveal lineage. tomaarsen confirms it's a bidirectional continuation of the Gemma 4 family, not continued from an older model, as those are all too large.
Related event: EmbeddingGemma2 Revealed as Bidirectional Gemma 4 Successor(3 posts)→