Open-Source Guide: Running a Fully Offline Voice Agent on Android in 1.2GB RAM
ivan_digital · reddit · 2026-08-13
A developer successfully deployed a fully offline voice assistant on a Galaxy S23 Ultra. The complete voice-to-action pipeline uses only about 1.2GB of memory, running speech recognition, action selection, and synthesis locally without internet.
Tech Stack & Highlights:
- Pipeline: Silero VAD → Parakeet-EOU 120M STT → FunctionGemma 270M → Android action → Pocket TTS.
- Model Control: FunctionGemma uses a 9.5MB adapter to output structured tool calls rather than open-ended responses.
- State Filtering: Filters available tools based on current device state (e.g., exposing "stop music" only when music is playing) to prevent invalid actions.
- Safety Checks: The model is not allowed to invent outcomes; contact and music searches are verified against real device data.
The prototype currently supports contacts, dialing, local music, and volume control. The author discusses the trade-off between extending a constrained action router and introducing a larger planner.
More from coding & agent
- ClawFlows Goes Viral: 113 Prebuilt Agent Workflows to Automate Your Daily Life — tom_doerr · 2026-08-13
- Paper2Agent: Open-Source System Turns Research Papers into Interactive AI Agents — tom_doerr · 2026-08-13
- Grok + Blender MCP: Animating 3D Models with a Single Prompt — chongdashu · 2026-08-13
- docker2exe: Convert Docker Images into Standalone Executables — tom_doerr · 2026-08-13
- Benchmark Reveals MCP Costs Up to 3x More Compute Than Plain Models — KitchenAmoeba4438 · 2026-08-13
- Open-source agent uses Gemini 3 Flash to autonomously write novels with streaming output and context compression — tom_doerr · 2026-08-13