A general VLM as a multimodal reranker: single-pass choices match dedicated rerankers

Zhuchenyang Liu · hf · 2026-10-21

A new paper frames multimodal reranking as a System One decision: a general vision-language model performs reranking via single-pass multiple-choice questions instead of a dedicated reranker.

On MMEB-V2 and ViDoRe V3, a zero-shot 27B VLM matches or exceeds dedicated 2B/8B rerankers, with lightweight decision tuning pushing performance further—collapsing the retrieve-rerank-generate pipeline into one model and eliminating reranker training/serving costs.

Original post →

More from Multimodal

Multimodal channel →