Hugging Face datasets 5.2.0 adds parallel streaming decode for image/audio/video
lhoestq · x · 2026-11-10
HF core dev lhoestq announces datasets 5.2.0: streaming now uses parallel decoding, greatly speeding up streaming decode for image/audio/video folder datasets. Also new: .gltf support in the 3D Mesh feature, column-local Feature updates, fixes for pushtohub dropping rows, duplicate WebDataset field rejection, and more.
More from Infra
- 26 researchers publish 212-page paper on feasibility of a "hardwired pause" of frontier AI — DavidSKrueger · 2026-11-10
- Frontier lab compute shifts hard: pre-training falls from 67% to 7%, post-training/RL now 55% — akbirthko · 2026-11-10
- Study of 1,600 Data Centers Finds Each Adds ~1,000-1,300 Local Jobs Within 3-5 Years — RachelVT42 · 2026-11-10
- rakyll teases Agent Substrate as 'agentic compute fabric' ahead of KubeCon keynote — rakyll · 2026-11-10
- ngrok AI Gateway adds Liquid AI and 160+ LLM API models; tiny LFM3-1.7B pages for a thirsty plant — JosephJacks_ · 2026-11-10
- Together Compiler hits 2.7x throughput gains on Kimi K3 at same per-user speed — togethercompute · 2026-11-10