Gemma 26B A4B Aces a C++ Coding Test Locally but Fumbles Tool Calls
HyperWinX · reddit · 2026-09-20
A Reddit user ran the Unsloth Gemma 26B A4B QAT Q4KXL GGUF locally with llama-server (MTP speculative decoding, 128K ctx, FP16 KV) and found it was the first model to one-shot their C++ HTTP server test. But tool calling in the Pi agent breaks down: it fails to submit plans and mixes up or forgets file-edit arguments, degrading badly past 30K context, with frequent repetition. Full llama-server flags included.
More from coding & agent
- Grok Bots 1.0 leaks: multiplayer teammates, proactive agents in Slack and Teams — XFreeze · 2026-11-12
- Could MCP-powered copy-trading disrupt ETFs? Investor floats paying 0.5% for trade signals — MartinGTobias · 2026-11-12
- minpts-check: one-run predictor tells if your HDBSCAN clusters survive min_samples changes — leland_mcinnes · 2026-11-12
- Ten wild Gemini 4 Carbon demos in 24 hours: CUDA meadows, V8 engines, mech stomps — socialwithaayan · 2026-11-12
- How to cut Fable 5.2 token costs by 90%: Arc routing plus a lean CLAUDE.md — EXM7777 · 2026-11-12
- Hamel Husain's complete AI evals framework for PMs and engineers — aakashgupta · 2026-11-12