Google rewrites SERP links to opaque google.com/goto redirects, raising the cost of scraping results at scale

jedisct1 · x · 2026-09-13

• Since late August 2026, Google Search consistently rewrites organic result links to google.com/goto?url=... when logged out or in private mode, hiding destination URLs from the HTML.
• Unlike the old google.com/url?q= wrapper, the new url parameter is an opaque reference to Google's index record that cannot be decoded offline; the real URL must be read from the Location header of a request to /goto (without following the redirect).
• The change targets automated SERP harvesting, especially AI crawlers and SEO scrapers: each result now requires a round trip back to Google, making bulk index-building slower, noisier, and easier to detect.

Original post →

More from Infra

• TSMC reportedly raising CoWoS packaging prices up to 20% next year on AI chip demand — Beth_Kindig · 2026-10-31
• effect-harness on Cloudflare: run agent loops, tools and credentials on separate VMs — samgoodwin89 · 2026-10-31
• Google's Project Suncatcher boots TPU in orbit and beams back first AI response — sundarpichai · 2026-10-31
• Together AI launches Post-Training platform for agentic RL with tool-use environments — togethercompute · 2026-10-31
• General Compute raises $100M for inference capacity as CoreWeave stock hits 12-month low — YvesMulkers · 2026-10-31
• Analyst warns of unstable AI compute feedback loop as Kioxia's NAND price warning triggers flash crash — bookwormengr · 2026-10-31

Infra channel →