Sentence Transformers v6.0 adds native ColBERT-style multi-vector retrieval, including ColPali
antoine_chaffin · x · 2026-08-18
Hugging Face shipped Sentence Transformers v6.0, adding a fourth model type, MultiVectorEncoder, for ColBERT-style late interaction (multi-vector) retrieval.
- Unlike dense embeddings that compress text into one vector, multi-vector models keep one vector per token and score via the MaxSim operator, preserving token-level matching that usually yields stronger retrieval at the cost of a bigger index.
- Any PyLate or Stanford ColBERT checkpoint loads directly; since ST now supports multimodal models, ColPali and other ColX visual document retrieval models can be trained and used with the same API — text queries match page images directly, no OCR needed.
- The blog covers loading checkpoints, encoding and MaxSim scoring, plugging into a search stack, running on page images, and keeping the index affordable — all on a plain pip install -U sentence-transformers.
More from coding & agent
- atuin v18.24 adds cross-device sync to resume AI threads across Claude and Codex — braelyn_ai · 2026-10-16
- Agents turn conservative as context grows: edits shrink from 150 to 30 lines — dbreunig · 2026-10-16
- ai& becomes an official built-in Cline provider with 13 open-weight models — DavidBennett__ · 2026-10-16
- Open-source rizin-mcp lets LLMs run local binary and malware analysis via Rizin — Pure_Emergency1424 · 2026-10-16
- x402 as a free GTM channel: agents discover 100+ tools, no API keys needed — 0xJeff · 2026-10-16
- Sam Altman: stop getting better at prompts, build loops and graphs that prompt for you — goyalshaliniuk · 2026-10-16