Scaling Reranked Retrieval report: some rerankers degrade when given too many documents
CShorten30 · x · 2026-11-18
CShorten30's team released the "Scaling Reranked Retrieval" research report; amplifier mrdrozdov highlighted two key findings:
- The "drowning in documents" problem persists: even recent rerankers sometimes drop in quality when reranking too many documents
- Listwise as a third retrieval stage looks compelling
Chart data: on five BRIGHT subsets, hybrid retrieval top-20 without reranking yields Recall@20 of just 0.282; ZeroEntropy zerank-2 with a k=2,000 pool raises it to 0.560; adding a Listwise GPT-5.6 Luna stage reorders the same 20 docs (Recall@20 pinned) and pushes Success@1 to 0.478.
More from Research
- Lean community certifies Riemann proof; honeypot fake keys expose breaches at three AI providers — LeviTurk · 2026-11-22
- Riemann hypothesis 'proven by Turkish mathematician using AI' claim mocked as the 'Organic Turk' — CatAstro_Piyush · 2026-11-22
- Andriy Burkov releases The Hundred-Page Language Models Book, hands-on with PyTorch — burkov · 2026-11-22
- Generative AI meets cardiology: Dagstuhl seminar bridges ML and clinical practice — StephanMandt · 2026-11-22
- SubRoformer hits SOTA music source separation with DSP subband filters — affige_yang · 2026-11-22
- Emily Riehl releases Lean game teaching dependent type theory at intro-to-proofs level — abhi9u · 2026-11-22