Sentence Transformers 6.2.0: DDP eval sharing and 43-61% faster cached model loading

tomaarsen · x · 2026-10-21

Sentence Transformers 6.2.0 highlights: with DDP training, evaluators automatically share encode()/predict() across ranks; rank zero combines predictions and computes full-dataset metrics for checkpoint selection and early stopping. Loading is faster too — the Hub revision resolves once and is reused: all-MiniLM-L6-v2 drops from 6.39s to 2.66s with HTTP requests down from 35 to 9, and load time falls 43-61% across four tested models.

Related event: Sentence Transformers 6.2.0 Speeds Up Loading by Up to 61%(2 posts)→

Original post →

More from coding & agent

coding & agent channel →