JVM runs NVIDIA Parakeet ASR at up to 2X the C++ reference speed, no GPU or Python needed
mkheck · x · 2026-09-24
The open-source jinfer-parakeet project implements NVIDIA Parakeet speech recognition entirely on the JVM — no GPU, Python, ONNX Runtime, or whisper.cpp required. It claims up to 2X the speed of the C++ reference implementation on ordinary CPUs, transcribing an hour of audio in 44 seconds.
- At F16 the transcript matches parakeet.cpp word-for-word; remaining differences are quantization noise
- Streaming support with a draft tail that keeps up with the speaker, plus word timings and per-token confidence
- Parakeet v3 handles multilingual transcription with automatic punctuation, no language flag needed
- First-class GraalVM Native Image support for fast startup and low memory
A practical option for teams wanting local, CPU-only ASR without leaving the Java ecosystem.
Related event: Parakeet.java Runs NVIDIA ASR on Pure JVM, Twice as Fast as C++(2 posts)→
More from Infra
- UK Sovereign AI invests in Fractile to build next-gen frontier AI chips — charlieharris01 · 2026-11-11
- What happened when I moved vector retrieval into Snowflake SQL instead of orchestrating RAG outside — dima806_dima · 2026-11-11
- AI chip startup Fractile raises $720M Series C for DRAM-on-processor design — Tom_Westgarth15 · 2026-11-11
- Mobile AI Factory: agentic pipeline builds on-device SLMs that beat 5-shot frontier models — kalyan_kpl · 2026-11-11
- Vivo's Starlink direct-to-cell service hits 10M users in two weeks across Brazil — XFreeze · 2026-11-11
- Nan Ya Plastics to spend NT$11.53B on fifth glass fabric plant on AI server demand — zephyr_z9 · 2026-11-11