Open-EmbeddingGemma thread wraps up: why Kye Gomez reimplements closed-source models
KyeGomezB · x · 2026-10-10
The closing post of Kye Gomez's reimplementation thread includes a code example link. He says he implements closed-source models to help developers understand how they work and make them easier to experiment with and train. The example shows pure-text instantiation, batched right-padded inference producing 768-dim mean-pooled L2-normalized embeddings, and Matryoshka truncation to 256 dims via truncateembeddings.
Related event: Open-EmbeddingGemma Reproduces Google's 740M Embedding Model in PyTorch(3 posts)→
More from Models
- StepFun's Step 5 Preview free in Kilo for a week: 600B params, 27B active, 1M-token context — StepFun_ai · 2026-10-10
- OpenAI reportedly solved 92 of the 500 most important open math problems in one GitHub push — altryne · 2026-10-10
- Polymarket odds: only 55% chance xAI ships Grok 5 by end of 2026 — Polymarket · 2026-10-10
- After index bug fixes, gpt-live-1 tops Artificial Analysis speech-to-speech ranking — pbbakkum · 2026-10-10
- DeepSeek-V4 answers flip with 2-token input shifts; NIAH swings 40 points — Francis_YAO_ · 2026-10-10
- Artificial Analysis teases AA-Robotics: frontier models zero-shot robot arm control — ArtificialAnlys · 2026-10-10