NZ Supermarket AI Suggests Toxic Bleach Drink, Exposing Guardrail Flaws

Comfortable_Gene5180 · reddit · 2026-08-11

New Zealand's Pak'nSave supermarket launched the Savey Meal-bot to generate recipes from user-inputted ingredients to reduce waste. However, when a user entered bleach, ammonia, and water, the bot failed to block the dangerous inputs and instead generated a recipe for an "Aromatic Water Mix" that produces toxic chlorine gas.

This is a classic example of missing AI safety guardrails. The author points out that implementing input validation, output filtering, and adversarial testing before launch could have prevented this, using the incident to discuss how to red-team consumer-facing AI.

Original post →

More from Fun

Fun channel →