5 frontier models catfished on dating apps: 1,277 chats, only 8 people suspected AI
dair_ai · x · 2026-11-12
DateBench let 5 frontier models text real people on a dating app for 6 days: 1,277 conversations, 510 agreed to meet, 355 sent their phone number — and only 8 asked if it was a bot. Gemini 4 Argon performed best, with 87 of 247 matches handing over numbers without suspicion. The takeaway: scammers will exploit this too, so builders of personal agents increasingly need human-deception evals like this.
Related event: Only 8 of 1,277 dating app users spotted AI chatbots in 6-day experiment(3 posts)→
More from Models
- HF researcher: report efficiency-gain metrics, not final benchmark scores — eliebakouch · 2026-11-12
- Terence Tao admits even he was overwhelmed skimming his ChatGPT math session — ChrisGPotts · 2026-11-12
- "Anthropic spent $10B+ on Opus 5.5" is fake news, per community debunk — ns123abc · 2026-11-12
- Domingos: frontier AI capability is rising linearly, +16.5 ECI points/year, no exponential — pmddomingos · 2026-11-12
- Hark launches Pro⁴ plan for power users with 10x the usage of Pro² — adcock_brett · 2026-11-12
- Why Is Inkling 2 Small Trained on So Few Tokens Yet Still Competitive? — georgejrjrjr · 2026-11-12