Run a Local Real-time Voice AI Assistant in a Single Docker Container
tom_doerr · x · 2026-08-13
Developer ShayneP open-sourced the local-voice-ai project on GitHub, featuring a fully local real-time voice AI assistant.
The project integrates STT, LLM, and TTS within a single Docker container, managed by a unified Python supervisor process. It relies on LiveKit Agents for real-time communication, uses llama.cpp to run a local LLM (defaulting to the Gemma 4 E2B quantized model), and integrates Nemotron STT and Kokoro TTS. The project aims to enable anyone to easily build a powerful, privacy-preserving local voice agent.
More from coding & agent
- VaultCMS: Turn Your Obsidian Vault into a Headless CMS for Astro — tom_doerr · 2026-08-13
- Where Does AI Agent + Travel API Integration Get Hard? Developers Weigh In — RouteStack · 2026-08-13
- Ito: AI Code Review Tool That Runs Your App on Every PR — Shruti_0810 · 2026-08-13
- CyberScraper 2077: AI-Powered Web Scraper with OpenAI, Gemini, and Ollama Support — tom_doerr · 2026-08-13
- Opinion: 90% of 'Agentic AI' is Just RPA with a Reasoning Layer — alex_verem · 2026-08-13
- Solo Dev Shares Honest Data: 163 Fugu Ultra Calls in Production — Future-Cook-6365 · 2026-08-13