QReason paper decouples chain-of-thought to cut reranking latency without losing accuracy

_reachsumit · x · 2026-09-28

The arXiv paper QReason introduces a query-focused decoupled chain-of-thought framework for passage reranking. Listwise LLM rerankers with sliding windows regenerate near-identical CoTs repeatedly, adding redundancy and latency. QReason trains a rewriter to produce a ranking-oriented reasoning query once and reuse it across all windows with a non-reasoning reranker. Training is two-stage: SFT with relevant-passage semantic evidence, then RL aligning CoT generation with listwise metrics and passage discrimination. On the BRIGHT benchmark it significantly reduces redundant reasoning while matching or beating strong reasoning rerankers.

Original post →

More from Research

Research channel →