Open-Source iOS App Runs Whisper, Qwen3-ASR & More Fully Offline
Zafrin_at_Reddit · reddit · 2026-08-05
A developer has released LiveTranscriber, an open-source iOS app that manages to run modern speech and language models like Whisper, Qwen3-ASR, Nemotron, and MOSS entirely on-device.
The app supports 100% offline speech recognition, multi-speaker transcription, and leverages Qwen3 locally for real-time summarization, key-point extraction, and translation. The developer noted that the main engineering challenges were tackling memory management, streaming latency, model loading, context handling, and battery usage on mobile. The project is fully open source.
Related event: Open-source iOS App LiveTranscriber Runs Multiple Models Offline(2 posts)→
More from Infra
- Running DeepSeek V4 Locally on Spark Hardware Hits ~95 tok/s — Rasmic · 2026-08-06
- Local Deployment: Running an NVIDIA and AMD GPU Together for Different Models — Curious-Pen5547 · 2026-08-06
- Luminal Compiler Discovers Insanely Fast Megakernels Without Quantization — AccBalanced · 2026-08-06
- Best Local LLMs for Every Mac: Run a 27B Model on Just 16GB RAM — JosephJacks_ · 2026-08-06
- Running 276B MoE Models on <10GB RAM: Mference Hits ~3 tok/s — Blahblahblakha · 2026-08-06
- RTX 3090 Test: INT8 Quantization Doubles MiniMax Video Generation Speed — Nevaditew · 2026-08-06