Scaling Hybrid Retrieval from k=100 to 2,000 Lifts Pool Recall to 0.871

CShorten30 · x · 2026-11-16

Part 3 of the Scaling Reranked Retrieval thread: hybrid retrieval (BM25 + Snowflake Arctic 2.0 embeddings) is scaled from k=100 to k=2,000, with average pool recall climbing steeply from 0.476 to 0.871.

This recall is the ceiling every downstream stage inherits — a relevant document not in the pool cannot be recovered later.

Related event: Scaling Reranked Retrieval: Hybrid Search Plus LLM Reranking Multiplies nDCG by 2.6x(3 posts)→

Original post →

More from Research

Research channel →