Dev scrapes 5.94B TikTok videos and 3.23B profiles in 3 weeks, uploads dataset to Hugging Face
DataShack · reddit · 2026-09-03
A developer has uploaded a full dataset of 5.94 billion TikTok videos and 3.23 billion profiles to Hugging Face for free, collected in about three weeks via a mobile app reverse-engineering method he built years ago that exposes 24 no-login endpoints for videos, profiles, comments, hashtags and sounds. He notes the approach likely violates TikTok's ToS, and the full code is paid, with a tutorial on his site. A major resource for large-scale video/social research, with real compliance risk attached.
More from Research
- Startup Mostik bridges AI models via their weights, tops ARC-AGI 3 at 1/20 the cost — nordicinst · 2026-09-03
- ByteDance's looped language models match 12B rivals at 1.4B size, with Bengio as co-author — peterjliu · 2026-09-03
- OpenAI's CoT monitorability hit: paper authors double down on 'fragile' AI safety window — GaryMarcus · 2026-09-03
- PufferLib author says retuning brings ~3x end-to-end speedup, up to 10x in some envs — yacineMTB · 2026-09-03
- Harvard Proposes Agentic Data Cracking, Cuts Unstructured QA Cost 53% on FanOutQA — Harvard · 2026-09-03
- Student runs explainable bone-lesion X-ray screener for £5/month — xrY- · 2026-09-03