We Read 900 Messages to a Sales AI Agent—What It Couldn't Answer Mattered Most
max_gladysh · reddit · 2026-11-20
After BotsCrew built an internal AI assistant for car dealership sales reps, the team manually read 900 real messages to see how it was actually used. Two patterns stood out: every 4th request was about trims and specs, and competitor-comparison questions came up 4x more often than comparisons of the brand's own models—reps mostly used it to prep the "why yours and not theirs" conversation before a customer walked in.
What the agent couldn't answer proved most valuable: 20 competitor questions kept failing. The obvious fix—plugging in the data provider's live API instead of static files—was validated first and would have fixed only 2 of the 20, because the models reps asked about simply weren't in the dataset. So they built nothing and sent the client a list of missing competitor models instead.
Takeaway: no amount of prompt engineering fixes data that doesn't exist. For internal agent builders—log every unanswered question and actually read them; they reveal real usage, missing data, and save you from spending a sprint on a fix that solves 10% of the problem.
More from coding & agent
- Genie 4 API goes live: precise camera-control for reframing and video — korymath · 2026-11-20
- GrepMem: Plain-Text Log Plus Regex Beats Summarization for Long-Horizon Agents — dair_ai · 2026-11-20
- Tripo Launches Agentic Canvas: AI Plans and Runs Your Full 3D Workflow — LinusEkenstam · 2026-11-20
- OpenAI to Cut Cursor Model Access on Nov. 12 After SpaceX's $60B Anysphere Acquisition — shashib · 2026-11-20
- Infor and AWS Break Down Their Enterprise Agent Stack, With Claude Sonnet 4.6 as Supervisor — shashib · 2026-11-20
- Meta's Benchmark Factory auto-builds coding evals from your own codebase — omarsar0 · 2026-11-20