Sentence Transformers v6.0: fp16 + FlashAttention Hits 3.87x Over fp32
tomaarsen · x · 2026-08-18
v6.0 performance notes: multi-column losses now run a single forward pass over merged columns, 1.25x faster on hard-negative & triplet training with identical loss trajectories; fp16 + FlashAttention is now the fastest GPU config at 3.87x over fp32. Breaking changes include transformers v5 & torch 2.2 as the floor, similarity/similaritypairwise becoming methods, trustremotecode=True required for custom module classes (including local paths), and a bare chat message list meaning one conversation instead of a batch.
More from coding & agent
- atuin v18.24 adds cross-device sync to resume AI threads across Claude and Codex — braelyn_ai · 2026-10-16
- Agents turn conservative as context grows: edits shrink from 150 to 30 lines — dbreunig · 2026-10-16
- ai& becomes an official built-in Cline provider with 13 open-weight models — DavidBennett__ · 2026-10-16
- Open-source rizin-mcp lets LLMs run local binary and malware analysis via Rizin — Pure_Emergency1424 · 2026-10-16
- x402 as a free GTM channel: agents discover 100+ tools, no API keys needed — 0xJeff · 2026-10-16
- Sam Altman: stop getting better at prompts, build loops and graphs that prompt for you — goyalshaliniuk · 2026-10-16