Ternary Bonsai 2 (2B/4B/9B) released: 2B runs in-browser at 500 tok/s on M4 Max
xenovatech · reddit · 2026-10-16
Prism ML released Ternary Bonsai 2, a ternary-weight model family in 2B, 4B, and 9B sizes on Hugging Face. The 2B runs entirely locally in the browser at up to 500 tok/s on an M4 Max thanks to custom WebGPU kernels.
Weights and a WebGPU demo are publicly available.
Related event: PrismML open-sources ternary Bonsai 2 models, 2B runs in browser at 0.43GB(8 posts)→
More from Infra
- Meta's Muse Spark Open scores 39 vs 48 for closed Spark 1.3 on AA Intelligence Index — EAccelerate_42 · 2026-10-16
- LLM spots useless 95GB-per-frame memcpy in ffmpeg dblur, cutting runtime from 2452ms to 49ms — IgorCarron · 2026-10-16
- Tree packing lands in TRL's AsyncGRPO, cutting agentic RL training compute by over 26x — joecole · 2026-10-16
- ASM's pizza-themed ALD explainer at SEMICON West is the best yet — BenBajarin · 2026-10-16
- Google's Willow chip cuts quantum errors 40x, raising Q-Day concerns for Bitcoin — jamestagg · 2026-10-16
- Vibe Coding a Data Pipeline Is Easy; Running It at Billions of Rows Is Not — Zachly · 2026-10-16