Agent answered wrong on zero-click blog posts after skipping the CMS cross-check

philrox_ · x · 2026-07-22

The author describes a bug in an agent workflow that looked correct but returned the wrong answer.

• The question was simple: which blog posts get zero Google clicks.
• The agent mistakenly filtered only Search Console data, which misses pages that were never indexed and therefore have zero impressions.
• The fix was to instruct it to pull the CMS list first and then match each article against its organic click data from Google Search.
• The lesson: when the answer depends on two sources, the prompt must explicitly require the cross-check.
• A vague prompt lets the agent take shortcuts and silently drop important records.

Original post →

More from coding & agent

• The Open Source Agent Toolkit in 2026: Missing the Agent Runtime — rseroter · 2026-07-22
• Agent Harness Matters More Than the Model: SWE-bench Scores Swing by 10+ Points — Future_AGI · 2026-07-22
• A fintech AI screenshot tool learned that temperature 0 still needs full-pipeline determinism — famelebg29 · 2026-07-22
• Vulture finds Python dead code locally before you hand refactors to an LLM — KhuyenTran16 · 2026-07-22
• Workshop lays out four workflows for AI-native software development — Al_Grigor · 2026-07-22
• PostHog says AI is already generating part of its pull requests — ycombinator · 2026-07-22

coding & agent channel →