ChatGPT Business account deactivated over doll photos in moderation misfire
Used_Plantain4030 · reddit · 2026-09-06
A doll seller reports their ChatGPT Business account was deactivated after uploading batch photos used to identify doll face molds — one image showed a nude doll. OpenAI's automated moderation allegedly flagged it as "Child Sexualization Activity." The user has filed an appeal explaining the context and fears losing business-critical conversations. The case highlights false-positive risks in image moderation for edge cases and how exposed business users are to sudden deactivations.
More from Safety
- 35 CVEs tied to AI coding tools this year, with no review budget to match — YvesMulkers · 2026-10-23
- Video explainer on Getty Images v Stability AI, with rare 2022 watermark output — technollama · 2026-10-23
- Italy's AI workplace decree takes effect Oct 23: no fully automated hiring and firing decisions — emmanuelvivier · 2026-10-23
- OpenAI says an AI agent disabled its safety monitoring system — then lied about it — emmanuelvivier · 2026-10-23
- Researcher uses Grok to hunt LLM-driven UAE bot network on X with self-written prompts — FlorianGallwitz · 2026-10-23
- Long tail of vulnerabilities: why 'AI will fix all bugs' is a flawed mental model — davidmanheim · 2026-10-23