embedflow: Zero-Downtime Embedding Model Migration Using 50 Reranked Docs Instead of 108-Day Backfill
Potential_Low_1183 · reddit · 2026-09-08
The problem
Re-embedding a billion documents to swap models takes 108 days on an H100 (tested with Qwen Embed 8B); even 50M vectors is costly.
The method: embedflow
- Take K documents from the old index and rerank them with the new model; with sufficient K, retrieval quality matches a native rebuild. Picking K is the hard part.
- Skips the expensive backfill entirely by reusing documents from the old index.
Validation & availability
- 63 migrations tested up to 1M documents; best result: Qwen 4B→8B reached native retrieval quality with just 50 documents.
- Works with Qdrant, open source: pip install embedflow (GitHub: arnsri33/embedflow).
More from coding & agent
- AI Operates Lab Robot: Claude Automates Yeast Colony Picking — nlarusstone · 2026-09-08
- Open-Source Chalkboarding Skill: AI Creates Chalkboard-Style Teaching Animations — Madisonkanna · 2026-09-08
- What evidence is strong enough to rule out a step when debugging agent workflows? — Sensitive-Parsnip-12 · 2026-09-08
- Notch demos AI-generated sparse voxel octree renderer without describing a single render pass — anselm · 2026-09-08
- Production teams confront the missing piece for autonomous agents: a reversibility layer to roll back mistakes — Anxious-Variation508 · 2026-09-08
- "I have not met anyone above 100IQ who runs a gorillion agents constantly," says AI commentator — examachine · 2026-09-08