Reranker Debate: New Paper Lifts BEIR Scores Amid Benchmark Contamination Concerns

The Querit-Reranker paper counters claims that rerankers are dead, lifting BEIR nDCG@10 from 54.11 to 59.28 via label-free adaptation, while critics flag benchmark contamination from training and evaluating on BEIR itself.

2026-10-09 ~ 2026-10-09 · 2 related posts

• Querit-Reranker Paper Pushes BEIR nDCG@10 from 54.11 to 59.28 — Jayyun98_dev · 2026-10-09
• Dev Slams Benchmark Contamination: Don't Train on BEIR and Evaluate on It — bo_wangbo · 2026-10-09