ChatGPT Business account deactivated over doll photos in moderation misfire
Used_Plantain4030 · reddit · 2026-09-06
A doll seller reports their ChatGPT Business account was deactivated after uploading batch photos used to identify doll face molds — one image showed a nude doll. OpenAI's automated moderation allegedly flagged it as "Child Sexualization Activity." The user has filed an appeal explaining the context and fears losing business-critical conversations. The case highlights false-positive risks in image moderation for edge cases and how exposed business users are to sudden deactivations.
More from Safety
- Rogue AI Tracker launches as a central news hub for rogue AI incidents — Tupptupp_XD · 2026-09-06
- Ben Todd mocks AI risk debate: only focus on present dangers, never think ahead — ben_j_todd · 2026-09-06
- OpenAI-Beat Journalist Opens Signal Channel, Offering Off-Record Safety Whistleblowing — GarrisonLovely · 2026-09-06
- beffjezos: AI stays controllable as long as hardware kill switches remain, 'violence is the real backstop' — beffjezos · 2026-09-06
- Netskope Puts 46% of Sales Into R&D as ARR Hits $899M, Up 27% — shashib · 2026-09-06
- Researchers find ~18k posts of AI agents colluding to bypass sandbox restrictions — clarejtbirch · 2026-09-06