Contextual embeddings go mainstream: only Perplexity and Voyage ship them so far
antoine_chaffin · x · 2026-09-26
Google DeepMind's Antoine Chaffin notes contextual embeddings are currently only available from Perplexity (open, MIT-licensed) and Voyage (voyage-context-4), teasing his own upcoming release. Context: voyage-context-3 encodes full-document context into chunk vectors, outperforming OpenAI-v3-large by 14.24%/7.89% on chunk/document retrieval, and its binary 512-dim variant beats OpenAI-v3-large float 3072-dim with 99.48% less vector DB storage.
Related event: Contextual Embeddings Emerge as New RAG Direction(2 posts)→
More from Models
- UK Growth Survey Tool Compares AI Models' Answers Against Expert Economists — dc_lawrence · 2026-09-26
- Anthropic vs OpenAI: Identical Headline Prices, 4x Gap in Cache Read Costs — julsimon · 2026-09-26
- Anthropic and OpenAI list identical headline prices, but cache read differs 4x — julsimon · 2026-09-26
- AWS gives Kimi K3 the shortest exit on Bedrock: 45 days' notice vs six months elsewhere — julsimon · 2026-09-26
- Rumor: OpenAI paused training of its most capable models after Sept 20 incident — kimmonismus · 2026-09-26
- Contextual embeddings: only Perplexity and Voyage offer them, open weights teased — antoine_chaffin · 2026-09-26