Eval: New Model Hits 91.4 NDCG@10, Leading by 6.2 Points
tomaarsen · x · 2026-08-26
Evaluated against 47 model configurations (dense, sparse, lexical, and multi-vector) on 1,000 held-out medical questions and 200,000 passages. The new model achieves a 91.4 NDCG@10, leading the best zero-shot model of any architecture by 6.2 points.
Related event: Fine-tuning ColBERT on a single RTX 3090 beats general-purpose retrievers(14 posts)→
More from Apps
- Dia AI browser officially launches on Windows — charliedeets · 2026-10-16
- Gemini Canvas workflow: turn a photo with measurements into an interactive 3D CAD studio exporting STLs — GeminiApp · 2026-10-16
- Self Labs launches Agent Vault to let AI agents log in and pay with credit cards — EXM7777 · 2026-10-16
- Teachers say students love interactive presentations built with Claude Opus 5.5 — S_Conradi · 2026-10-16
- Firecrawl raises $75M Series B, launches Fireround funding intel in ChatGPT and Claude — mcraddock · 2026-10-16
- Notion launches 150+ MCP connections to pipe HubSpot, Stripe data into agents — ivanhzhao · 2026-10-16