Only 8.9% of Sites Block AI Crawlers, Yet 94.8% Are Never Cited
SpikeyCoder · hn · 2026-08-02
An analysis of website AI visibility reveals that while only 8.9% of sites actively block AI crawlers, a staggering 94.8% are never cited in AI search answers. This indicates that even if sites remain open to AI, the vast majority fail to gain any exposure or traffic from AI engines.
More from AGI Musings
- DHH: Starship, Starlink and Grok should have been Europe's Sputnik moments — georgemillo · 2026-10-16
- Hinton hits back at Jensen Huang: 'He has good reason to say AI isn't dangerous — he sells Nvidia chips' — BlackHC · 2026-10-16
- Yudkowsky blasts new interpretability finding as primitive; critic pushes back on doomer logic — AlexTensor · 2026-10-16
- Beff Jezos declares 'civilizational inflection point' in the acceleration of technological progress — beffjezos · 2026-10-16
- Data scientist: pivoting to AI engineering is the safest career bet for the next 5 years — mdancho84 · 2026-10-16
- AI will be superhuman at science regardless, and Europe can't opt out — teortaxesTex · 2026-10-16