Research: A free 300M Gemma model predicts Gemini embeddings at 0.83 cosine similarity
dejanseo · x · 2026-08-14
Research demonstrates that a single 768×768 matrix can map vectors from Google's free, local Gemma-300m model onto the output of the paid gemini-embedding-001 API. On 50,000 held-out Wikidata entities, the mapped vector achieves a 0.83 cosine similarity to the true Gemini vector. A pure rotation recovers 0.77, while adding stretch and shear raises it to 0.831, effectively recovering the entity vector structure without API costs.
More from Research
- Netflix details its production LLM judge: hundreds of thousands of recommendations scored weekly — omarsar0 · 2026-08-24
- Nature Comment: Provenance, not interpretability, grounds trust in autonomous science — gabepgomes · 2026-08-24
- New Architecture RHEA: Train 1B Model on 8GB VRAM — zemondza · 2026-08-24
- Trained two 16M-param models to do generative CAD with real physics — debreuil · 2026-08-24
- Claude model helps discover complex structure on S^6, solving 60-year-old math problem — Singularitarian · 2026-08-24
- Study: Agents read instructions/notes 60.5% of the time, rarely touch API docs — dair_ai · 2026-08-24