VoiceShelf ships on Android: offline Kokoro TTS hits 45x realtime via custom NPU runtime

Simple-Lecture2932 · reddit · 2026-11-23

A developer launched VoiceShelf, a fully offline Android audiobook app reading EPUBs with Kokoro as a one-time-purchase alternative to ElevenLabs' $700+/year subscription. By rewriting Vulkan kernels for GPU and building a custom runtime to bypass QNN's dynamic-shape limitations on Qualcomm NPU, it now runs 24x realtime on NPU alone (7-8% battery/hour), up to 45x with a CPU+GPU+NPU hybrid scheduler — up from 2.8x with heavy heat and 20%/hour drain. iOS and other chips are next.

Original post →

More from Infra

Infra channel →