JAX-JS makes Kyutai Pocket TTS run at 2.5× realtime in the browser on Wasm CPU
dejavucoder · x · 2026-07-27
- The Kyutai Pocket TTS in-browser demo now runs in real time on WebAssembly CPU, thanks to library-level optimizations in jax-js.
- The author says no model code was changed. The speedup came from a transposed-convolution bottleneck that is now 30× faster, plus JIT compiler fixes.
- The demo now runs at more than 2.5× realtime in the browser on Wasm, building on last month’s SIMD and threaded codegen work.
More from Infra
- AI Shipping Labs opens code for 10 workshops on agents, vLLM, and vector search — Al_Grigor · 2026-07-27
- Observer builds local agents that watch your screen, mic, and camera for alerts — alex_verem · 2026-07-27
- What OS and coding models should power a dedicated local AI box with a 3090 and 5060 Ti? — PolarNightProphecies · 2026-07-27
- Whisper-based voice bots are hitting 1.5-second lag and breaking on interruptions — Dull_Look_2320 · 2026-07-27
- Moonshot says Kimi-K3 open weights are due today, but it needs 64+ accelerators — heypearlai · 2026-07-27
- llmux manages vLLM and llama.cpp model swaps with one profile per model — Available-Message509 · 2026-07-27