How to Verify if an Agent Actually Did the Work
Slightly_F0ol1Sh · reddit · 2026-07-16
After running agents in production for months, the author's biggest headache isn't whether the model can talk, but how to confirm it actually got the job done.
Core Issues
- Agents often claim they "saved/found it" and report completion, but no real side effects actually occur.
- These errors don't surface immediately; they accumulate downstream and are only discovered much later.
Current Practices
- Stop trusting the agent's own output.
- Use a "dumb" method for external verification: e.g., checking if a new row actually exists in the database, or if a file was truly written to disk.
- If there are no real results, fail the step immediately rather than passing silently.
Unsolved Challenges
- Long-term drift is harder to catch: an agent might work fine today but silently fail weeks later without triggering system alerts.
- The author wants to hear how others distinguish between "the agent actually did it" and "it just claimed it did."
Related event: AI agents in production: don’t trust narration, verify outcomes(8 posts)→
More from coding & agent
- Inspired by OpenAI's 10,000-agent run, dev open-sources a crowdsourced agent problem-solving platform — Benjaminsen · 2026-09-11
- Lucid: open-source Mac app keeps your laptop awake only while AI agents run — Pitiful_Hedgehog_600 · 2026-09-11
- banteg's snail project crowdsources AI agents to finish matching Snail Mail's 20 remaining functions — banteg · 2026-09-11
- Alex Townsend posts 200 open problems in numerical linear algebra for humans and AI agents — IgorCarron · 2026-09-11
- Kimi K2.8 Preview rolls out: near-K3 coding performance, 1M context for all tiers — teortaxesTex · 2026-09-11
- Looking for a classifier of software engineering task shapes to pick models per task — StewartalsopIII · 2026-09-11