Skipping the cross-encoder stage: LLM reranking alone costs 6x for +0.017 nDCG

CShorten30 · x · 2026-11-16

Tweet 9/17: skipping the cross-encoder and handing GPT-5.6 Luna hybrid retrieval's top-100 directly yields 0.375 nDCG@10 — barely above zerank-2's 0.358 on the same pool, at 6x the price. With zerank-2 first retaining top-100 from k=2,000, Luna's listwise pass reaches 0.482, showing the cheap cross-encoder prefilter is the pipeline's keystone.

Related event: Reranking Study Finds Two-Stage Pipeline Beats Fusion and Deeper Windows(13 posts)→

Original post →

More from Research

Research channel →