VoiceShelf ships on Android: offline Kokoro TTS hits 45x realtime via custom NPU runtime
Simple-Lecture2932 · reddit · 2026-11-23
A developer launched VoiceShelf, a fully offline Android audiobook app reading EPUBs with Kokoro as a one-time-purchase alternative to ElevenLabs' $700+/year subscription. By rewriting Vulkan kernels for GPU and building a custom runtime to bypass QNN's dynamic-shape limitations on Qualcomm NPU, it now runs 24x realtime on NPU alone (7-8% battery/hour), up to 45x with a CPU+GPU+NPU hybrid scheduler — up from 2.8x with heavy heat and 20%/hour drain. iOS and other chips are next.
More from Infra
- Basalt engine runs Inkling-2-Mini at 613 tps on one RTX 5090, 3x faster than llama.cpp — udmrzn · 2026-11-23
- Ex-Goldman CEO Blankfein: AI Is Now Disrupting the Earnings-Stock Price Relationship — firstadopter · 2026-11-23
- Databricks exec: inference providers routinely botch ZDR commitments — pwendell · 2026-11-23
- Cerebras CEO: architecture choices sidestep HBM, CoWoS and TSMC 3nm bottlenecks — rohanpaul_ai · 2026-11-23
- Open-source Kapitsa hits 960+ tok/s prefill on M5 Max with 4-bit Hy4-flash — 0zyman23 · 2026-11-23
- Alabama Power to cut rates $160M thanks to data center revenue — binarybits · 2026-11-23