ChatGPT Still Cites URLs Even After Being Blocked
lilyraynyc · x · 2026-07-17
This post highlights an interesting phenomenon: while the author is actively trying to block OpenAI's crawlers, ChatGPT still frequently performs site: searches to find the site's "official content" and includes those URLs in its citations.
As a result, even though ChatGPT cannot directly access the page content, the site still receives referral traffic from ChatGPT. The author speculates that ChatGPT might be combining its training data with information from other sources to generate answers, rather than relying on real-time crawling of the blocked pages.
More from Apps
- A market map tracks outpatient healthcare agentic AI across front, back and mid office — HealthcareAIGuy · 2026-07-21
- Synthesia launches Dubbing 2.0 with 130+ languages and lip-sync video translation — synthesiaIO · 2026-07-21
- Linear Launches Loops: Automate Workflows with Plain English Instructions — xiaohu · 2026-07-21
- Halliday opens priority access to G2 display AI glasses for meetings and daily use — SucceededMind · 2026-07-21
- A homework-photo app found the hard part is not OCR but date ambiguity and task splitting — Hayk_D · 2026-07-21
- Google says AI Mode queries are 3x longer, and users often never leave it — SuB8u · 2026-07-21