Hugging Face open-sources 200+ WebGPU kernels for in-browser local AI
xenovatech · reddit · 2026-10-01
A developer has open-sourced what they call the world's fastest WebGPU kernel collection for local AI on Hugging Face, covering more than 200 common ML operations that run entirely locally in the browser via WebGPU. The author says they are working to upstream these optimizations into Transformers.js, ONNX Runtime Web, LiteRT.js and more.
- Kernels: huggingface.co/kernels?platform=webgpu
- Blog: huggingface.co/blog/webgpu-kernels
- Goal: faster in-browser local inference, less reliance on cloud compute
Related event: Xenova open-sources 200+ WebGPU kernels for in-browser AI(2 posts)→
More from Infra
- Mobile AI Factory: agents auto-build on-device SLMs with 19x less GPU time — pmttyji · 2026-11-16
- vLLM serves DeepSeek V4.1-Flash at 954K tokens/s per GPU, $38.96/GPU-hour on GB300 NVL72 — bookwormengr · 2026-11-16
- Colossus 2's 1.2M B200s could generate ~$400B/year in tokens at DeepSeek Flash rates — bookwormengr · 2026-11-16
- BIS issues rule blocking remote access to US AI chips via third-country data centers — teortaxesTex · 2026-11-16
- Qdrant 1.20.1: 50% fewer cold-storage reads, ~2x faster quantization, agent-ready setup — qdrant_engine · 2026-11-16
- One 16GB GPU runs songs, voice, images, 720p video and local RAG — all offline and open source — llama-of-death · 2026-11-16