Blink CPU speed test: model2vec 3.8x faster solo, Sentence Transformers 2.2x faster at batch 1024
tomaarsen · x · 2026-11-18
tomaarsen benchmarked Blink static models on an i7-13700K with short texts: for single queries, model2vec was 3.6-3.8x faster across both models; with batchsize=1024 for both, Sentence Transformers was 2.2x faster. He expects the Rust model2vec-rs implementation to beat both.
For lightweight deployments, model2vec runs the same models via NumPy without PyTorch, and since Blink embeddings are normalized, a dot product yields cosine similarity.
More from Infra
- Roboflow: vision AI faces a long-tail problem — BNSF runs bespoke models on 32,500 miles of track — PTrubey · 2026-11-18
- Open-source Personal AI Computer: DIY 2–8 GPU builds with full BOM, CAD and guides — dee_hw · 2026-11-18
- Runway cuts real-time 57B video model serving from 8 H100s to 4 with inference optimizations — runwayml · 2026-11-18
- Over half the power for America's largest data centers comes from gas and coal — The Decoder · 2026-11-18
- Nvidia halts US-approved H200 shipments to China after $2.4B quarter — kimmonismus · 2026-11-18
- Analyst: Hyperscaler Nvidia spend may be flat once segment reclassification is accounted for — RihardJarc · 2026-11-18