Late Interaction outperforms dense models by 12 points in tests
tomaarsen · x · 2026-08-26
Tomaarsen compared Late Interaction against dense models. At matched training and backbones, the Late Interaction model won by +12 points over its Dense sibling. The strongest dense model, Qwen3-Embedding-4B, with 33x more active parameters, still fell short by 13 points.
More from Research
- PrimeIntellect verifiers v0.3.1: Model Interception and Persistent ACP Sessions — xeophon · 2026-08-27
- RAG Isn't Dead: Navigating Retrieval vs. Agentic Search — hugobowne · 2026-08-27
- AI audit not infallible: Refine missed a known lemma error in paper — littmath · 2026-08-27
- AI audit of 19 papers: 97.7% of comments identified real issues — littmath · 2026-08-27
- Mathematician's AI-generated errata are "slop" but mostly correct — littmath · 2026-08-27
- Mathematician Litt: Paper Errors Mostly From Badly Propagated Edits, Not Deep Flaws — littmath · 2026-08-27