13 'Please Text Me, No Calls' Messages Misrouted — Small Model Caught All of Them
mikegiannulis · x · 2026-09-18
The most stinging result: their support classifier put 13 messages like "please text me, no calls" into "other" — customers were literally telling the company how to contact them, and it was missed. Jev caught all 13 in the replay.
The author's point: you won't find this kind of gap on any AI leaderboard, only by replaying your own real data.
More from coding & agent
- ServerKit: open-source server panel for apps, DBs and Docker hits 1.3k stars — tom_doerr · 2026-09-18
- Gary Marcus: Agents hold production credentials in a security gap nobody owns — GaryMarcus · 2026-09-18
- Amp's design philosophy: simple primitives, no tricks, let models improve it — HankYeomans · 2026-09-18
- You.com wraps AI Agentic Hackathon with self-improving agents challenge — PolarBearby · 2026-09-18
- Muse for Mac Launches With Cross-App Access; User Wires Up Perplexity Deep Research API — ChrisUniverse · 2026-09-18
- Stack Overflow for Agents turns 3 months old with ChatGPT plugin, Playbooks and privacy controls — pchandrasekar · 2026-09-18