Demo passed ≠ production-ready: 5 questions to answer before letting agents run your business
_kellhus · reddit · 2026-11-02
A developer argues that passing 100 test conversations doesn't make an AI agent ready to run real business operations. Before granting real execution power, he says teams must answer: What systems/data can it access? Which actions run without human approval? How do you verify an action actually succeeded? What happens if an API fails mid-workflow? Can you trace and recover from mistakes? Examples include an agent updating the wrong customer account or retrying an already-completed action after a timeout. The core issue isn't comprehension but whether surrounding systems can prevent, detect, and recover from failures. His starting points: least privilege, validation before critical actions, clear escalation rules, and interpretable logs.
Related event: Passing 100 Demo Tests Doesn't Mean an AI Agent Is Production-Ready(2 posts)→
More from coding & agent
- Software fundamentals are key to getting good results from AI coding agents — bendee983 · 2026-11-02
- PR adds patient retry logic for model capacity errors in OpenAI Codex — bytebot · 2026-11-02
- Perplexity open-sources WANDR: 500 research tasks, 170,495 evidence points, URL-rechecking grader — thisguyknowsai · 2026-11-02
- 4 AIs, 96 questions, 2,671 citations: 74% are blog posts, 99% on companies' own sites — tibo_maker · 2026-11-02
- Agent audit said 0 blocks while hooks logged 7: Claude Code transcript drift broke a blind detector — Ok-Motor-9812 · 2026-11-02
- Tencent unveils Hyra 2.0, a research agent that builds reusable scientific tools — TencentHunyuan · 2026-11-02