embedflow: Zero-Downtime Embedding Model Migration Using 50 Reranked Docs Instead of 108-Day Backfill
Potential_Low_1183 · reddit · 2026-09-08
The problem
Re-embedding a billion documents to swap models takes 108 days on an H100 (tested with Qwen Embed 8B); even 50M vectors is costly.
The method: embedflow
- Take K documents from the old index and rerank them with the new model; with sufficient K, retrieval quality matches a native rebuild. Picking K is the hard part.
- Skips the expensive backfill entirely by reusing documents from the old index.
Validation & availability
- 63 migrations tested up to 1M documents; best result: Qwen 4B→8B reached native retrieval quality with just 50 documents.
- Works with Qdrant, open source: pip install embedflow (GitHub: arnsri33/embedflow).
Related event: Open-Source embedflow Enables Zero-Downtime Embedding Model Migration(3 posts)→
More from coding & agent
- Hook everything into the Dot: a workaround to stretch ChatGPT subscription limits — teortaxesTex · 2026-10-27
- UCSB CS Prof. Xifeng Wang lands 3 grants worth $180K+ for practical agentic AI research — xwang_lk · 2026-10-27
- Gen games don't need to be realtime — turn-based interactivity works, devs argue — djcows · 2026-10-27
- Player rebuilds Street Fighter II in HD with Claude: $3,000 of tokens, 3 weeks — Fantastic-Jeweler781 · 2026-10-27
- How to ace the "send us something cool" AI interview: research interviewers with agents, then focus — brandon_galang · 2026-10-27
- Give AI a clean personal-data-free machine with full control: agents running 24/7 teach you more than any course — EXM7777 · 2026-10-27