Bonsai 2 27B ships with ternary weights: 5.95GB model hits 98.2% of FP16 benchmarks
airesearch12 · x · 2026-09-18
Bonsai 2 27B is out with ternary weights: the language model is just 5.95GB versus 54GB in FP16, while scoring 98.2% of the FP16 Qwen3.8 27B benchmarks.
Key details:
- Runs at 55 tok/s via WebGPU on an M5 Max, with a browser demo available
- 27B reasoning model with vision, tool use, and agentic support
- Open weights released
Related event: PrismML's Ternary Bonsai 2 27B Shrinks to 5.9GB, Retains 98.2% Performance(20 posts)→
More from Infra
- Marvell-Lumentum deal signals what it takes to compete with Broadcom — BenBajarin · 2026-11-02
- Sam Altman: AI query energy cost fell 1,000x-100,000x in 3-4 years — rohanpaul_ai · 2026-11-02
- Marvell and Lumentum to merge, targeting $550B AI connectivity market — BenBajarin · 2026-11-02
- Samsung chairman visits Yokohama advanced packaging lab, pledging ¥40B investment over five years — pstAsiatech · 2026-11-02
- Sam Altman meets Samsung executives in Korea to deepen memory chip and AI infrastructure cooperation — pstAsiatech · 2026-11-02
- Simulating 200,000 months: can your home AI rig pay rent at 2026 GPU prices? — LeviTurk · 2026-11-02