I built a voice AI chief of staff that runs off my Obsidian vault

BreadfruitSimilar642 · reddit · 2026-10-20

A Redditor shares 'Jarvis,' a voice-driven personal AI whose value is entirely in the wrapping around the model: hands (acts on real files and tools), memory (everything lives in an Obsidian vault instead of a context window, retrieved on demand), and structure (vault organization aids lookup). It reads/writes notes, does semantic search, builds small apps on request, runs local actions, self-checks health, and talks by voice — with hard guardrails: no self-modification or unapproved actions, and it admits uncertainty. Current pain points include speech-to-text mishearing queries, stale audio routing after switching Windows outputs, and an Obsidian MCP permission gap forcing workarounds. The author is soliciting ideas for recurring tasks, required access, and trust-breaking failure modes.

Original post →

More from coding & agent

coding & agent channel →