Common Crawl releases experimental graph embeddings for 52.9M web hosts

lhoestq · x · 2026-09-09

Common Crawl has published Web Graph Embeddings, an experimental dataset providing a 128-dimensional embedding for each of 52.9 million web hosts, learned purely from hyperlink structure in the Common Crawl Web Graph. Two interactive Hugging Face Spaces accompany the release for exploration. The dataset targets tasks like host similarity and link-graph analysis.

Original post →

More from Research

Research channel →