Ternary-Bonsai-2-27B 2-bit MLX quantized model trends on Hugging Face
prism-ml · hf · 2026-09-18
prism-ml's Ternary-Bonsai-2-27B MLX 2-bit quantized model is trending on Hugging Face. It targets on-device text generation with ternary quantization, hybrid attention (prismhadamardqwen35), and CUDA/Metal support, squeezing a 27B-class model into 2-bit for local inference.
Related event: PrismML's Ternary Bonsai 2 27B Shrinks to 5.9GB, Retains 98.2% Performance(20 posts)→
More from Infra
- Amazon's $215B capex exceeds $168B operating cash flow, FCF turns -$42B — thealexbanks · 2026-11-02
- BofA: B200 and H100 GPU rental prices hit new highs, up 47% and 31% YTD — TheZachMueller · 2026-11-02
- vikhyat predicts alternating compute oversupply and undersupply on the road to AGI — TheZachMueller · 2026-11-02
- PyTorch Mac downloads hit 3.29M in October, up 20.5% MoM — LysandreJik · 2026-11-02
- CVSS 9.8 ingress-nginx flaw lets unauthenticated attackers get RCE and steal cluster Secrets — evilsocket · 2026-11-02
- RAM prices tripled, so Tesla cut a third of memory from Optimus's brain — aakashgupta · 2026-11-02