LightOn Achieves 2x Lossless Compression for ColBERT
antoine_chaffin · x · 2026-07-07
LightOn announced that by introducing hierarchical pooling, they achieved 2x lossless compression on the ColBERT retrieval model's state, calling it an even bigger "free lunch." The technology aims to reduce the storage and deployment costs of retrieval models.
More from Research
- LightMTP: lightweight latent multi-token prediction boosts LLM planning in pretraining — gdm3000 · 2026-10-27
- EMNLP study: AI literary translation reads fine but varies more, even within one book — tuvllms · 2026-10-27
- Lab monkeys at $30-80K each: a 4-year breeding cycle is the real preclinical drug bottleneck — zebird0 · 2026-10-27
- OpenAI Foundation funds UNC tumor antigen project, hiring senior experimental scientist — iskander · 2026-10-27
- Steering attention heads toward honesty: up moral patienthood, down psychopathy — edelwax · 2026-10-27
- Are transcoders overkill? New paper argues plain neurons suffice for circuit analysis — burny_tech · 2026-10-27