OpenBMB releases Ultra-FineWeb-L1, a 1T+ token high-quality web dataset
zibuyu9 · x · 2026-08-21
OpenBMB released Ultra-FineWeb-L1, an English web corpus with over 1T tokens derived from the latest Common Crawl snapshots (CC-MAIN-2025-51). It contains approximately 1.14 billion documents and utilizes a refined processing pipeline—including text extraction, language filtering, deduplication, and sensitive field replacement—to enhance data quality. It serves as the L1 filtered layer in the UltraData management framework for LLM pretraining.
Related event: OpenBMB Releases Ultra-FineWeb-L1, a 1T+ Token Web Corpus(3 posts)→
More from Infra
- Nvidia's developer base hits 11 million, up ~3.7x from 3 million in 2021 — Beth_Kindig · 2026-10-16
- Muse Spark Open runs locally on a Mac M3 Ultra via llama.cpp: frontier model on desktop — pcuenq · 2026-10-16
- Muse-Spark open-weights drop: 816B-A42B MoE model gets 359GB MLX 3-bit build — ns123abc · 2026-10-16
- Meta launches Muse Spark Open, says it runs on two M5 Ultra Mac Studios with Apple's help — The Verge AI · 2026-10-16
- vLLM ships Day-0 LoRA RL for Muse Spark Open, lifting AIME from 0.56 to 0.85 — vllm_project · 2026-10-16
- DSpark draft model for Muse Spark Open proposes 7 tokens per pass with 23-42% acceptance — vllm_project · 2026-10-16