Ternary-Bonsai-2-27B, a 2-bit ternary model for on-device inference, trends on Hugging Face
prism-ml · hf · 2026-09-18
prism-ml's Ternary-Bonsai-2-27B is trending on Hugging Face as an open text-generation model.
- Released in GGUF format, runnable directly in llama.cpp with CUDA and Metal support
- Uses ternary (2-bit) weights aimed at local/on-device deployment
- Features a hybrid-attention architecture for end-side efficiency
Related event: PrismML's Ternary Bonsai 2 27B Shrinks to 5.9GB, Retains 98.2% Performance(20 posts)→
More from Infra
- Amazon's $215B capex exceeds $168B operating cash flow, FCF turns -$42B — thealexbanks · 2026-11-02
- BofA: B200 and H100 GPU rental prices hit new highs, up 47% and 31% YTD — TheZachMueller · 2026-11-02
- vikhyat predicts alternating compute oversupply and undersupply on the road to AGI — TheZachMueller · 2026-11-02
- PyTorch Mac downloads hit 3.29M in October, up 20.5% MoM — LysandreJik · 2026-11-02
- CVSS 9.8 ingress-nginx flaw lets unauthenticated attackers get RCE and steal cluster Secrets — evilsocket · 2026-11-02
- RAM prices tripled, so Tesla cut a third of memory from Optimus's brain — aakashgupta · 2026-11-02