Qdrant open-sources a production-scale vector search benchmark: billions of vectors, thousands of RPS
qdrant_engine · x · 2026-09-01
Qdrant argues public benchmarks don't come close to production conditions — billions of vectors, thousands of RPS, tight tail latency — so it built and open-sourced its own: corpus and hosting from Hugging Face, compute from Vultr, distribution via SkyPilot, plus the Supernova code and dataset.
They say the era of 1M-vector datasets and synthetic approximations is over; evaluation should use real data with real ground truth and open tooling.
Related event: Qdrant Open-Sources Supernova Benchmark for Billion-Scale Vector Search(2 posts)→
More from Infra
- Auction-based LLM routing paper finds fixed token pricing wastes 10%-71% in costs — _onionesque · 2026-10-18
- Running Ling 3.1 Flash (560B MoE, 25B Active) Across 4 DGX Sparks via llama.cpp RPC — BerryBlush_Rogers691 · 2026-10-18
- SGLang Summit sponsors jump from 11 to 36 in one week — ying11231 · 2026-10-18
- Oracle CDS hits record 300bps, called first AI trade domino after Barclays sell downgrade — arthurcolle · 2026-10-18
- Agent Coding Workflow Would Cost ~$40k/Month on API Pricing, Dev Reveals — ChrisRackauckas · 2026-10-18
- PS5LM: llama.cpp port turns a jailbroken PS5 into a home LLM server (500+ GitHub stars) — wateriscoding · 2026-10-18