Gemma 26B A4B Aces a C++ Coding Test Locally but Fumbles Tool Calls
HyperWinX · reddit · 2026-09-20
A Reddit user ran the Unsloth Gemma 26B A4B QAT Q4KXL GGUF locally with llama-server (MTP speculative decoding, 128K ctx, FP16 KV) and found it was the first model to one-shot their C++ HTTP server test. But tool calling in the Pi agent breaks down: it fails to submit plans and mixes up or forgets file-edit arguments, degrading badly past 30K context, with frequent repetition. Full llama-server flags included.
More from coding & agent
- A 30-day roadmap to master Claude: from casual chatbot to thinking partner — goyalshaliniuk · 2026-09-20
- Vibe coder can't read AI-generated code: black-box testing alone hits a wall — Ryan_yii · 2026-09-20
- Projects keep breaking: vibe coder asks for a full practical workflow — Ryan_yii · 2026-09-20
- Open-source testsprite CLI lets coding agents self-test live backend APIs and auto-fix failures — KARYTON618 · 2026-09-20
- OpenEnv sees active community work on infra providers, MCP and WebSocket fixes — ben_burtenshaw · 2026-09-20
- mitsuhiko on the Shared Frustrations of Agentic Software Engineering — mitsuhiko · 2026-09-20