Poldi: A Fully Offline Local Voice AI Assistant That Runs on 8GB VRAM
rhinodevil · reddit · 2026-10-25
A hobbyist released Poldi, a GPLv3 fully offline local AI assistant with speech UI: wakeword hands-free client, browser client, chat resume, web/Wikipedia search, interruptible LLM, memory extraction, and EN/DE support. Stack: Whisper.cpp + llama.cpp + Piper. Targets GPU-poor hardware — works well on 8GB VRAM, CPU-only possible; hands-free client is Linux-only (Raspberry Pi works as satellite).
More from Infra
- Reflection AI open-sources Beam: 500B-parameter model trained in 2 months with near-zero downtime — dl_weekly · 2026-10-25
- Zeroth-order pretraining 4000x faster in 10 days, but 99.9% of directions never explored, warns practitioner — burny_tech · 2026-10-25
- AI startups' hottest business role: negotiating compute access; Arora says profit pool shifts from chips to compute owners — annbordetsky · 2026-10-25
- Running multiple GPUs per PCIe slot with a switch: inference traffic is tiny — net_termina · 2026-10-25
- Used NVIDIA DGX Spark reselling at $6,200, well above its ~$4,000 retail price — AIFlow_ML · 2026-10-25
- SGLang Matches DeepInfer on Prefill, Adds 7.4% Decode Throughput on 64×GB300 — BanghuaZ · 2026-10-25