Sentence Transformers v6.0 Tests 51 Late-Interaction Checkpoints Out of the Box

tomaarsen · x · 2026-08-18

v6.0 directly tests 51 checkpoints: 29 text retrieval and 22 visual document retrieval, from 17M to 8.8B parameters, covering LateOn, GTE-ModernColBERT, mxbai-edge-colbert, LFM2-ColBERT, colbertv2.0, answerai-colbert-small, ColPali, ColQwen and more. Training matches the existing experience: 4 new losses (cached & distillation variants), 5 new evaluators, and a Trainer with familiar arguments; from a bare ModernBERT-base, NanoBEIR mean nDCG@10 goes from 0.1338 to 0.4831 in 25 minutes on one RTX 3090.

Related event: Sentence Transformers v6.0 Ships Late-Interaction Multi-Vector Models(27 posts)→

Original post →

More from coding & agent

coding & agent channel →