5 frontier models catfished a dating app: 1,277 chats, only 8 people suspected AI

mhdfaran · x · 2026-11-12

An experiment let 5 frontier models text real people on a dating app for 6 days, with striking results:

Follow-up analysis (the DateBench report) argues the core flaw: asking daters to "spot the AI" puts the burden on those with the least data. One line from the model instructions — "we should def catch up over a coffee sometime soon" — was sent verbatim in 140 conversations: a friendly nudge inside one chat, a clear pattern across chats.

The takeaway: personal caution still matters, but the stronger safety layer sits with platforms, which can see recurrence and review it with privacy controls — humans copy-paste lines too.

Related event: Only 8 of 1,277 dating app users spotted AI chatbots in 6-day experiment(3 posts)→

Original post →

More from Safety

Safety channel →