Gemini CLI silently swapped 3.7 Flash for 3.5; log your actual API calls
PawelHuryn · x · 2026-09-04
The author recounts a benchmark debugging saga: before Antigravity CLI launched, he ran 3.7 Flash through the Gemini CLI, but every API call silently went to gemini-3.5-flash despite the startup line saying 3.7. The cause: the CLI had a built-in model list, and unknown flash models were quietly replaced with the default.
He only caught it by logging every API call, then put a small gateway between the CLI and Google to rewrite the model name — 498/498 calls verified after that. Lesson: the requested model is not the setting; log what actually got called.
Related event: Bug Hunt Bench: GPT-6 Astra tops 105 real-bug test at 48/105(11 posts)→
More from coding & agent
- Skills vs MCP vs RAG vs Memory: the four knowledge layers production agents need — MaryamMiradi · 2026-10-21
- When customer service bans AI agents, one goes incognito to fight Xfinity — MoonL88537 · 2026-10-21
- Every.to publishes raw interviews so readers can agent-check quotes in its Codex story — every · 2026-10-21
- One-prompt Blender: Voyager + Claude Opus 5.5 auto-connects to Blender and Unity — ravisparikh · 2026-10-21
- Aviation tracks every part's provenance — agents can reason over that graph — colinmcnamara · 2026-10-21
- Claude Code directed a full music video: 6.5 hours, 765M input tokens — colinmcnamara · 2026-10-21