Testing AI Agents: Complement Not Replacement for Scripts
PartyVermicelli1870 · reddit · 2026-09-02
After a month of testing coldtea-ai's QA agent alongside a suite of 180 deterministic Playwright tests, the author found it caught 3 real bugs missed by scripts, including one long-standing issue. While the agent spends time on false positives in areas scripts would ignore, the conclusion is that it serves as a valuable addition rather than a replacement for deterministic testing.
More from coding & agent
- Boomi launches AI Gateway to stop risky agent actions mid-execution — shashib · 2026-09-02
- Anthropic Claims MCP Protocol SDK Hits Hundreds of Millions of Monthly Downloads — emmanuelvivier · 2026-09-02
- Can diagram-driven development make a comeback with LLMs? A Reddit discussion — JBO_76 · 2026-09-02
- AIR Raises $50 Million to Audit AI Agent Skills and Extensions — emmanuelvivier · 2026-09-02
- ICTFax-MCP: An MCP Server to Let AI Agents Send and Track Faxes — ictinnovations · 2026-09-02
- Yegge: Any model will eventually build systems it can no longer maintain — jimmykoppel · 2026-09-02