Dev builds accountability layer to track agent commitments from open to fulfilled
xspyyy · reddit · 2026-09-04
A Reddit developer with a year of agent-building experience highlights a recurring gap: agents make commitments ("report by Friday", "follow up tomorrow") but nothing tracks whether they're actually fulfilled — output gets logged, yet failures are only discovered by digging through old traces.
His experimental fix is an accountability layer that:
- Extracts commitments from agent output
- Tracks them through a state machine: open → due → overdue → fulfilled/failed
- Fires webhooks when commitments become overdue or fail
His open question is the extraction/routing threshold: anything below 0.92 confidence goes to pendingreview instead of automatic tracking, and he's unsure confidence thresholds are even the right mechanism. He's asking production agent operators how they handle this today — manual log review, application database tracking, observability tooling, or purpose-built systems — and offers to share his data model and docs.
More from coding & agent
- OpenAI showcases GPT-6 Astra: 3D London history, matcha site and DEF CON puzzle via parallel agents — OpenAI · 2026-09-04
- swyx Burned 20B Tokens Stress-Testing Astra on Real AI Engineering Tasks — All for Under $6/Hour — charliermarsh · 2026-09-04
- LangChain launches free LangSmith Essentials course covering the full agent dev lifecycle in 60 minutes — Hacubu · 2026-09-04
- OpenAI's Lukasz Kaiser: even we can't pinpoint what caused the Christmas coding-agent jump — a_karvonen · 2026-09-04
- Dev says Cloudflare's Wrangler CLI is the most agent-friendly way to run cheap infra — dinasaur_404 · 2026-09-04
- Google Labs launches Play with Putty, a real-time collaborative vibe coding tool — testingcatalog · 2026-09-04