Hillock replaces vector DBs with SQLite and SIMD hypervectors for local RAG under 1.2GB VRAM
Equivalent-Flan-1590 · reddit · 2026-10-03
The creator open-sourced Hillock (v0.8), a local RAG pipeline that ditches vector databases:
- Problem: running Chroma alongside an 8B model eats VRAM, and cosine similarity over chunks fails hard-negative rejection, causing confident hallucinations
- Approach: lightweight bi-encoders extract relational facts into SQLite in 5 seconds, bypassing the generative LLM during ingestion
- Anti-hallucination gate: queries pass a 10,000-dim hypervector gate with late-interaction scoring; if there's no mathematical overlap with the fact graph, the LLM call is blocked before token generation
- v0.8: hypervectors bit-packed into 157 uint64s, gating under 0.01ms via CPU popcount; OpenAI-compatible API works with Open WebUI, AnythingLLM, Obsidian; on PyPI as pip install hillock
- Trade-off: tuned for structured relational facts (specs, people, dates), precision over recall — not for broad narrative summaries
More from coding & agent
- Claude Code overtakes Cursor and Copilot in job-post mentions ahead of Anthropic IPO — antgoldbloom · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- Orchestrator's Cloud Agents graduate from beta to general availability — julianweisser · 2026-11-19
- Zero users, 33 pages shipped: dev crowdsources audit for AI-agent trust schema — TheHamzaShahbaz · 2026-11-19
- She vibecoded her own photobooth with Claude Code — and shared the prompt — toolstelegraph · 2026-11-19
- Should AI Agents Write to Your Memory or Only Read? Dev Weighs In — jordimr · 2026-11-19