We Read 900 Messages to a Sales AI Agent—What It Couldn't Answer Mattered Most

max_gladysh · reddit · 2026-11-20

After BotsCrew built an internal AI assistant for car dealership sales reps, the team manually read 900 real messages to see how it was actually used. Two patterns stood out: every 4th request was about trims and specs, and competitor-comparison questions came up 4x more often than comparisons of the brand's own models—reps mostly used it to prep the "why yours and not theirs" conversation before a customer walked in.

What the agent couldn't answer proved most valuable: 20 competitor questions kept failing. The obvious fix—plugging in the data provider's live API instead of static files—was validated first and would have fixed only 2 of the 20, because the models reps asked about simply weren't in the dataset. So they built nothing and sent the client a list of missing competitor models instead.

Takeaway: no amount of prompt engineering fixes data that doesn't exist. For internal agent builders—log every unanswered question and actually read them; they reveal real usage, missing data, and save you from spending a sprint on a fix that solves 10% of the problem.

Original post →

More from coding & agent

coding & agent channel →