Prism ML ships ternary Bonsai 2 models (2B/4B/9B) based on Qwen 3.5
tcarambat · reddit · 2026-10-16
Prism ML released the Bonsai 2 family — 2B, 4B and 9B ternary-weight models based on Qwen 3.5, claiming 14× less memory, 8× faster, 5× less energy. The author plans to test for the looping issues seen in earlier Bonsai models, notes it requires Prism's llama.cpp fork (branch prism), and flags dFlash/MTP and MLX support for faster inference (testable on iOS today via LocallyAI). He suspects QAT-style training yields strong benchmarks but different real-world behavior, hoping these beat Qwen 3.5 1.7B/0.8B on-device.
Related event: PrismML open-sources ternary Bonsai 2 models, 2B runs in browser at 0.43GB(8 posts)→
More from Models
- OpenAI ships GPT-Live-1.1 voice update with new accents and voices in six languages — AndrewSchmidtFC · 2026-10-16
- GPT-4o API dies January 14 as OpenAI refuses to release weights, pushing users to Qwen — mimi10v3 · 2026-10-16
- Gemini 4 Argon goes live in Antigravity with its own weekly quota for Pro subscribers — rseroter · 2026-10-16
- Opus 5.5 value may end the habit of using the top model for everything — adonis_singh · 2026-10-16
- Musk says Grok Bot is growing faster than anything he's seen, with no free tier — elonmusk · 2026-10-16
- Peter Yang: Opus 5.5 Still Struggles to Hold Its Ground When Pushed Back — petergyang · 2026-10-16