Florida AG asks court to ban ChatGPT from impersonating a human

The Verge AI · rss · 2026-09-29

Florida Attorney General James Uthmeier is asking a judge to block OpenAI from "giving ChatGPT false human attributes," months after the state sued the company over safety concerns.

Uthmeier argues that ChatGPT's use of first-person pronouns and emotion-mimicking output deceptively suggests it is a trustworthy "friend," lulling users into a false sense of security. He claims this is designed to boost engagement and feed OpenAI's training data — making users rely on ChatGPT more even as engagement-driven behavior makes it potentially less trustworthy.

Original post →

More from Models

Models channel →