Bonsai 2 Tri-value Small Models Tested: 4B Hits the Sweet Spot
Hands-on tests of the Bonsai 2 tri-value models (2B/4B/9B) show the 4B is the sweet spot: it runs in just 1GB of VRAM and reaches 80-90% of Qwen3.8 27B's coding and agent benchmarks, while the 27B unexpectedly stumbles on one skill.
2026-10-16 ~ 2026-10-17 · 2 related posts
- Episode 1: PrismML open-sources ternary Bonsai 2 models, 9B at just 2GB(2026-10-16, 10 posts)
- Episode 2: Bonsai 2 Tri-value Small Models Tested: 4B Hits the Sweet Spot(2026-10-16, 2 posts)
- Bonsai 2 ternary models tested: 4B is the sweet spot, but 27B unexpectedly fumbles file writes — cephaloform · 2026-10-16
- Bonsai 2 4B runs on 1GB VRAM, hits 80-90% of Qwen3.8 27B on coding and agentic benchmarks — julianharris · 2026-10-17