sentence-transformers cuts model loading time 43-61% by slashing Hub HTTP requests

tomaarsen · x · 2026-10-21

sentence-transformers maintainer tomaarsen details loading speedups in v6.2.0: the Hub revision is resolved once and reused across downloads, cutting redundant HTTP requests. Across four tested models, loading time dropped 43–61% — e.g. all-MiniLM-L6-v2 went from 6.39s to 2.66s, with requests down from 35 to 9. This applies to models already in cache.

Related event: Sentence Transformers 6.2.0 Speeds Up Loading by Up to 61%(2 posts)→

Original post →

More from coding & agent

coding & agent channel →