Sentence Transformers SparseEncoder: Sparse Retrieval in a Few Lines
tomaarsen · x · 2026-09-17
Third post in tomaarsen's SparseUp thread: Sentence Transformers now ships a SparseEncoder interface, fully compatible with the new Linkup-sparseup-embed-v1.
- Sparse encoders: mostly-zero vectors enable efficient large-scale retrieval; non-zero dims map to specific tokens for interpretability; combinable with dense embeddings for hybrid search
- Usage: load SparseEncoder("naver/splade-cocondenser-ensembledistil"), call encode() for [3, 30522] sparse vectors, similarity() uses dot product by default
- sparsity() reports sparsity ratio (>99% typical) and average active dims; promptname / encodequery() / encodedocument() handle query vs document prompts
Full docs on the Sentence Transformers site.
Related event: Linkup Open-Sources SparseUp: 149M-Parameter Sparse Retriever Tops BEIR-13(12 posts)→
More from Models
- 'You Can Feel the Gradient Slopes': Dev Contrasts Benchmaxxed RL Models vs General Ones — theteknosaur · 2026-11-02
- LightOnOCR-3 Launches: Tops FRBench, Adds Layout Structure and Chart Extraction — IgorCarron · 2026-11-02
- NVIDIA's Kumo Is a Family of Four Tabular Foundation Models, Not Just One — pandeyparul · 2026-11-02
- SemiAnalysis: safety classifiers are underrated — Meta's Muse tops cyber benchmark at 35.2% — ThomasScialom · 2026-11-02
- DeepSeek V4.1 Flash 1017 wins over a longtime closed-source-only user: fast, cheap, reliable — _bachrc · 2026-11-02
- Local quants vs Claude on 9 real private bugs: 3-bit costs thinking time, not score — FeydRowan · 2026-11-02