Meta AI crawler walks into honeypot, grabs fake API key and returns from another IP in 34 seconds

minhnguyen · x · 2026-11-22

A developer set a honeypot on his site: robots.txt disallowed /internal/, where he planted a fake API key as bait. Meta's AI crawler (IP 57.141.0.38) ignored the rule, grabbed the key, and came back 34 seconds later from a different IP using it — direct evidence that Meta's "respects robots.txt" claim doesn't hold.

His revenge: redirecting the crawler into an infinite trap of 10 billion beige rectangles, each page linking to 12 more with no nofollow — pure noise for Meta's training corpus. "Infinite llama 5 is going to know so much about rectangles."

Beyond the drama, it demonstrates a practical honeypot technique for detecting crawler abuse: bait assets, callback logging, and blocking based on the resulting evidence.

Original post →

More from Fun

Fun channel →