Builder wants phone-to-self-hosted voice chat over VPN with local GPUs
morphles · reddit · 2026-07-28
- The poster wants to set up phone-to-self-hosted-server voice chat over VPN.
- They already run a moderate local model machine with 2× 7900 XTX GPUs and use llama.cpp with Vulkan to run Gemma 4 comfortably.
- They are looking for recommendations on the phone app/client side and the server-side stack, and mention they tried LocalAI but were not impressed.
- The discussion is about practical self-hosted voice assistant infrastructure and local model deployment.
More from Infra
- NVIDIA says Jetson now fits in a bag while powering robots and edge AI — nordicinst · 2026-07-28
- India can assemble a finished chip in Gujarat, but the core is still imported — santoshpanda · 2026-07-28
- Open competition targets 36.8% faster Laguna XS 2.1 inference on consumer Macs — gajesh · 2026-07-28
- Make electricity abundant first, then AI abundance will follow — XFreeze · 2026-07-28
- Laguna S 2.1 claims 6% of DeepSeek V4 Pro’s size with higher performance — gajesh · 2026-07-28
- Google appears to be packaging model distillation as a service — giveen · 2026-07-28