HilbertRaum: open-source app packs local models, docs and chats onto a USB drive
Vladowski · reddit · 2026-09-20
An open-source project called HilbertRaum packages local models, runtimes, documents and chat history onto a USB stick or SSD — plug it into any computer, unlock, and pick up where you left off.
Key features:
- Chat and document Q&A with source citations
- At-rest encryption via AES-256-GCM + Argon2id
- Fully offline: no cloud fallback, web search, or telemetry
- Hardware detection with model recommendations
- Built-in workflows for bank statements, invoices, contract summaries, and anonymization
Technical details:
- Electron/React/TypeScript, with llama.cpp and whisper.cpp as sidecars
- A local API at 127.0.0.1:4980/v1, off by default, serves completions only
- ZIM knowledge packs (offline Wikipedia via kiwix-serve) are queried on demand rather than embedded; the author reports they markedly cut hallucinations in smaller models, at the cost of speed and a required BGE Reranker v2 M3
The pitch: hand a non-technical friend a fully set-up drive as their intro to local AI.
More from Infra
- Game engines and inference engines both boil down to multi-user batching, and agentic bots — yunta_tsai · 2026-09-20
- Tutorial: speculative decoding in vLLM to cut LLM latency and double tokens per second — MaiaStudios · 2026-09-20
- Charles Frye: KV Compression Fails Rarely but Expensively at Long Context, and New Models Need It Less — charles_irl · 2026-09-20
- Two vLLM bugs hid in plain sight: Mamba state cache, decode-before-prefill and a 32-bit wrap — AI Engineer · 2026-09-20
- Analyst: enterprises overpay 10-20x for cloud AI as on-prem inflection nears — DavidLinthicum · 2026-09-20
- A $36,000 Cloudflare Bill Sparks Warning: No Hard Spend Limit, Set Billing Alerts — ThePeterMick · 2026-09-20