Sentence Transformers v6.0 Released with MultiVectorEncoder for ColBERT-Style Models

antoine_chaffin · x · 2026-08-19

Sentence Transformers v6.0 introduces the MultiVectorEncoder, making ColBERT-style late interaction models a first-class citizen alongside dense, sparse, and reranker models. Unlike dense models that compress text into a single vector, multi-vector models keep one vector per token, scoring every query token against every document token and summing the best matches for improved semantic retrieval.

Related event: Sentence Transformers v6.0 Ships Late-Interaction Multi-Vector Models as First-Class Citizens(40 posts)→

Original post →

More from Models

Models channel →