Microsoft's EigenLI: training-free spectral compression of ColBERT-style representations
lateinteraction · x · 2026-09-10
Microsoft researchers present EigenLI, a training-free spectral method that compresses ColBERT-style multi-vector representations. The key observation is that multi-vector representations lie in low-rank, seemingly document-specific subspaces, and the method exploits this for practical compression. It outperforms clustering pooling and MUVERA single-vector baselines, while raising new questions about the geometry of multi-vector model spaces.
Related event: Microsoft's EigenLI Compresses ColBERT Representations Without Training(2 posts)→
More from Research
- Will Automating AI R&D Trigger a Software Intelligence Explosion? Paper Analyzes — nabeelqu · 2026-09-10
- Can Language Models Reproduce Creative Breakthroughs from Historical Data? Scientists Investigate — CatAstro_Piyush · 2026-09-10
- Same async program, four different outputs: paper maps the async/await design space across 7 runtimes — IanArawjo · 2026-09-10
- Valeo fits scaling laws for video diffusion using 5,500 hours of driving footage — abursuc · 2026-09-10
- Microsoft researchers show CPU cache attack that reconstructs local LLM output via the detokenizer — dair_ai · 2026-09-10
- Arena unveils GameDevBench: tutorial-derived, verifiable game dev benchmark for frontier models — arena · 2026-09-10