Hillock replaces vector DBs with SQLite and SIMD hypervectors for local RAG under 1.2GB VRAM
Equivalent-Flan-1590 · reddit · 2026-10-03
The creator open-sourced Hillock (v0.8), a local RAG pipeline that ditches vector databases:
- Problem: running Chroma alongside an 8B model eats VRAM, and cosine similarity over chunks fails hard-negative rejection, causing confident hallucinations
- Approach: lightweight bi-encoders extract relational facts into SQLite in 5 seconds, bypassing the generative LLM during ingestion
- Anti-hallucination gate: queries pass a 10,000-dim hypervector gate with late-interaction scoring; if there's no mathematical overlap with the fact graph, the LLM call is blocked before token generation
- v0.8: hypervectors bit-packed into 157 uint64s, gating under 0.01ms via CPU popcount; OpenAI-compatible API works with Open WebUI, AnythingLLM, Obsidian; on PyPI as pip install hillock
- Trade-off: tuned for structured relational facts (specs, people, dates), precision over recall — not for broad narrative summaries
More from coding & agent
- Engineer builds production-grade PCB in 3 weeks with AI, works on first revision — cneuralnetwork · 2026-10-03
- Jev open-sourced: PowerShell module turns natural language into typed AI decisions — dfinke · 2026-10-03
- Video explains Jev agent examples: games, triage, and browser use — RelevantEmergency707 · 2026-10-03
- Making Claude music videos: upload your own audio instead of browser-driving Suno — technollama · 2026-10-03
- 'AI Babysitter' Is the New Job: Keeping Agent Queues at 100% Utilization — petesena · 2026-10-03
- Antigravity CLI 1.2.15 runs the full coding agent on Android via Termux — kalyan_kpl · 2026-10-03