MV-IVF: an inverted-file index built natively over multi-vector embeddings

_reachsumit · x · 2026-11-10

MV-IVF builds an IVF-style index directly over multi-vector embeddings instead of relying on single-vector proxies or filter-and-rerank. Key insight: once point clouds are assigned to clusters, the center-update step reduces to standard single-vector clustering, enabling MV-Lloyd, a Lloyd-style algorithm clustering point clouds under a Chamfer objective to build a hierarchical IVF tree.

Queries use best-first beam search over the tree, accelerated by low-bit quantization, query compression, and cache-efficient batched search. Implemented in the optimized C++ library MVSIC, showing strong latency-recall tradeoffs on BEIR and LoTTE.

Original post →

More from Research

Research channel →