Honeypot catches Tencent crawler disguised as iPhone ignoring robots.txt to steal fake API key

rickasaurus · x · 2026-11-22

Developer @chiefofautism trapped violating crawlers with a honeypot: despite robots.txt disallowing /internal/, a Tencent crawler from Hong Kong IP 101.32.49.171, disguised as an iPhone, entered the bait page, grabbed a fake API key, and returned 40 minutes later from a different Tencent IP (43.134.38.171, Singapore) to use it. A quoted earlier case shows a Meta AI crawler (57.141.0.38) doing the same and reusing the fake key from another IP just 34 seconds later — mocking claims that these crawlers "respect robots.txt."

Original post →

More from Fun

Fun channel →