Gym's chatbot invented a free membership-pause policy; team shares its guardrail lessons

Fit_Satisfaction541 · reddit · 2026-11-19

A gym's customer-facing chatbot hallucinated a "pause your membership free for three months" policy that never existed, and the member posted the screenshot in the town's Facebook group.

Running on Orq.ai, the team added a guardrail evaluator that checks every answer against the membership terms; failing answers route to staff instead of the member, tested first on historical transcripts.

The hard part is tuning:

The OP proposes only checking answers that say yes to something, since every invented policy so far started with yes, and asks how others catch made-up promises without escalating every boring question.

Original post →

More from coding & agent

coding & agent channel →