How a 50-customer B2B app automated QA with agents simulated from production MLflow traces

Lopsided_Feedback_81 · reddit · 2026-11-20

A dev running a B2B data-analysis app (50 customers, 2-10 users each) shares how they automated QA with AI agents:

They admit the simulation isn't perfect and unseen cases can still break, but models are now smart and cheap enough that automated agents beat their previous time-consuming manual QA.

Original post →

More from coding & agent

coding & agent channel →