Fine-tuned Gemma 4 12B for 2.7x Better Tool Calling on 16GB VRAM
TheOneWhoWil · reddit · 2026-08-23
Unable to fit larger models on 16GB VRAM, the author fine-tuned Gemma 4 12B specifically for tool calling and CLI usage.
Results:
- Achieved a 2.7x improvement in tool calling reliability.
- Increased the volume of attempted tool calls by 15.7%, helping the model stay active rather than getting lost in reasoning loops.
Assets: fp16 to Q4KM weights are available for use with llama.cpp or Ollama.
More from coding & agent
- Vercel Goes Full Backend: Python GA, Containers, and Daemons — cramforce · 2026-10-16
- Datadog Debuts Scout 1.0, a Domain Model for Incident Investigation — tianyin_xu · 2026-10-16
- WorldMemArena Accepted at NeurIPS: Memory Storage ≠ Memory Use — xwang_lk · 2026-10-16
- Vercel Ship Demos Container Deploys for Go, Ruby, Java and More — edwin · 2026-10-16
- TRL adds day-0 support for fine-tuning Muse Spark Open's 816B MoE with LoRA on 64 H100s — QGallouedec · 2026-10-16
- Databricks engineers land impactful PRs on day 2 with AI dev tools, vs week 3 before — Yuchenj_UW · 2026-10-16