Reversing TikTok's mobile API: 5.94B videos and 3.23B profiles scraped in 3 weeks
BLUECOW009 · x · 2026-09-04
A 30-minute technical guide explains how to bypass headless-browser scrapers and web endpoints by talking directly to TikTok's private Android HTTP+JSON API. It covers the four hard parts — device credential registration, request signing, regional host partitioning, and TLS fingerprinting — across 24 endpoints, each with measured success rates.
Using this system, the author collected 5.94 billion videos, 3.23 billion creator profiles, and 2.8 billion comments in three weeks, and released metadata for 4.5 billion videos (captions, view/like/comment/save counts, sounds, country, posting time) as a free dataset on Hugging Face.
Pullable data also includes full creator video histories, follower graphs, similar-creator recommendations, complete comment threads, trending sounds charts, hashtags, keyword search, and trending shelves.
Related event: Developer scrapes 5.94B TikTok videos in 3 weeks, open-sources dataset(2 posts)→
More from Infra
- Perplexity's Portable Computer agent stack now runs locally on DGX Spark and 24GB RTX GPUs — cameronstow · 2026-09-04
- PyTorch Conference NA Oct 20-21: kernel optimization, ExecuTorch, guardrails agenda — PyTorch · 2026-09-04
- Ben Bajarin: 2027 is the peak year of AI compute constraint, supply relief comes 2028 — BenBajarin · 2026-09-04
- How one startup runs its entire analytics stack on Cloudflare — ritakozlov · 2026-09-04
- 71% oppose, 261 moratoriums: US data center approvals are freezing over — shashib · 2026-09-04
- Micron explores near-GPU NAND flash to run bigger LLMs — giveen · 2026-09-04