Low-VRAM user claims applying a Qwen-style chat template fixes Ternary Bonsai 2's tool calling
needthosepylons · reddit · 2026-09-23
- Stuck with 8GB VRAM, the author found ternary-weight model Ternary Bonsai 2 struggled badly at tool calling — it failed at building a simple Tetris game.
- Applying the chat template from Tiel Coder to Bonsai, they report a large improvement in behavior and tool calling, even one-shotting the Tetris game.
- The author is asking whether this is plausible — a low-VRAM local-user experiment others can replicate.
More from coding & agent
- Dev wires r-1 to Jev for real-time PDF Q&A with on-page highlighting, no embeddings — iamrobotbear · 2026-09-23
- Proofpress pitches an 'Intelligence Ledger' to audit AI-generated claims like financial books — tallmetommy · 2026-09-23
- Microsoft's Agensh scales to 1,024 agents, lifting pandoc pass rate to 55% — MicrosoftResearch · 2026-09-23
- Testing Claude Opus 5.5 on Pixel Art: One Prompt Builds a Looping Animated Scene — HugoDuprez · 2026-09-23
- Claude-built Paper Mario-style med student demo might become a full game — BraydonDymm · 2026-09-23
- Jev PowerShell module ships: turn messy input into typed AI decisions — dfinke · 2026-09-23