Google's Gary Illyes: keep important content in HTML as LLMs crawl the web
lilyraynyc · x · 2026-09-16
SEO practitioner Lily Ray relays Gary Illyes' remarks at a conference about Google's indexing history and lessons for the LLM era.
- Around 2007-2010, Google had a freshness problem: it wasn't surfacing the newest information.
- It shipped Caffeine (Percolator) to serve fresher results, then built a web rendering engine to process JavaScript and emulate what users see in their browsers.
- Despite that capability, Illyes argues important content should still live in plain HTML — especially now, since LLM-based systems crawling the web may not render JS the way a browser does.
More from coding & agent
- Workshop 0.3.1: Open-Source Execution Architecture for Grounded AI Work — Promptmethus · 2026-09-16
- Energon: Open-source self-hosted storage and publishing service built for AI agents — kieranklaassen · 2026-09-16
- lateinteraction: let agents compile expensive LLM calls into cheap AI functions, likely via DSPy — lateinteraction · 2026-09-16
- Dev builds MCP server feeding Claude curated UI/UX patterns, seeks feedback — Separate-Topic4883 · 2026-09-16
- SwiftUI co-creator defends client-side animations: dropping Core Animation was deliberate — JordanMorgan10 · 2026-09-16
- Building a browser game inside a Gaussian splat made in World Labs Marble — theworldlabs · 2026-09-16