Hugging Face Datasets hits 2B downloads, 1M datasets, new features teased
lhoestq · x · 2026-11-06
Hugging Face's Quentin Lhoest shared that the Datasets library has hit 2 billion downloads with 1M public datasets, and teased work in progress: merged distributed HSDP docs, backbone for LeRobot streaming datasets, newly added Vortex column formats, upcoming 3D/simready support, and an open PR for bio data via biotite.
More from Infra
- Veteran investor: memory stocks aren't cheap even at P/E of 3 as LTAs are meaningless — bookwormengr · 2026-11-06
- Enterprise AI's future is local: tactical workloads favor Dell, HPE, Lenovo, Supermicro over frontier labs — DavidLinthicum · 2026-11-06
- Texas Governor-Elect: Approved Data Centers Can Be Completed, New Projects to Pay Taxes — GavinSBaker · 2026-11-06
- Marin's open 535B-A23B MoE finishes main pretraining on 18T tokens, checkpoints soon — dlwh · 2026-11-06
- Buoyant Open-Sources Kinference, an Inference Control Plane for vLLM on Kubernetes — vllm_project · 2026-11-06
- vLLM ranks #2 most-engaged open-source repo in GitHub Octoverse, #8 by contributor growth — vllm_project · 2026-11-06