Sentence Transformers 6.2.0 cuts training memory with quadratic/linear loss storage

tomaarsen · x · 2026-10-21

Sentence Transformers 6.2.0 reduces training memory: BatchSemiHardTripletLoss intermediate memory drops from cubic to quadratic, BatchAllTripletLoss to quadratic for paired labels, and CoSENTLoss/AnglELoss (including sparse variants) now use linear intermediate storage. Large BatchAll label groups can still be cubic.

Original post →

More from coding & agent

coding & agent channel →