mini-RAG open-sourced: fully local pipeline with DeepSeek R1, Ollama, Qdrant hybrid search
tahahussein-4623a412 · reddit · 2026-10-01
The author open-sourced mini-RAG, a fully local RAG app running DeepSeek R1 7B via Ollama, with the interesting part being the retrieval pipeline rather than the chat UI.
Full flow: documents → chunking → BGE-M3 embeddings → dense + sparse retrieval → Qdrant → RRF hybrid search → BGE Reranker → relevance gate → context quality filter → context builder → DeepSeek R1 answering with sources.
The author explicitly avoids "retrieve and blindly send to the LLM", insisting on retrieve → rerank → validate relevance → filter → generate. JWT auth and user-level isolation scope retrieval to the authenticated user instead of the whole vector DB. Open source on GitHub; the author asks the community what to change before calling it production-ready, especially around retrieval quality, reranking, context construction, and local inference performance.
More from coding & agent
- Generic API-catalog MCP server vs one tool per job: a context-bloat experiment — MandeepKaur9407 · 2026-11-16
- Berkeley paper: LLMs answer with stale values even when the update is in context — ombre-ai · 2026-11-16
- Effective HTML: 4.2k-star agent skills turn wireframes into self-contained interactive prototypes — tom_doerr · 2026-11-16
- skills-gate: one gate skill fronts 148 agent skills at just 389 tokens — Distinct-Pie2389 · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- shadcn boosts @uisdk: one-shot UI rebuild that's instantly E2E-testable by AI — shadcn · 2026-11-16