Open-source PlaceBench tests 6 voice assistants on 150 real-place questions: Dots 92, Ask Maps 49

whowasntright · reddit · 2026-11-21

A Reddit writeup of PlaceBench, an open-source (CC-licensed) benchmark of 150 real-world venue questions across 121 cities, grading six AI assistants against each venue's own website, notices, and transit timetables. Wrong answers subtract a full point.

Two failure modes stand out: 12 answers pointed people to closed or relocated venues, and repeating 20 questions three times caused answer flips (Instinct was consistent on only 5/20). The author argues map snapshots lag venue counters on live edge questions like tonight's reservations or holiday hours, hence pairing lookup with phone verification — and promotes PlaceCall, an AI calling service for US businesses that discloses it's an AI on a recorded line and bills $0.10 per quoted answer, $0 on holds.

Original post →

More from coding & agent

coding & agent channel →