The Stack v3 becomes the largest open code dataset at 114 TB and 5T tokens
soldni · x · 2026-07-24
The Stack v3 has been released as the largest open code dataset so far: 114 TB, 770 languages, 224M repositories, and about 5T deduplicated and filtered source-code tokens.
What changed from v2
- v2 (2024): 68 TB raw, filtered down to 2 TB / 550B tokens, covering 618 languages.
- v3 (2026): 114 TB raw, expanded to 770 languages and 224M repositories.
- The release claims no restrictively licensed code is included.
This is a major dataset-scale jump for open code pretraining and code research.
Related event: Hugging Face Releases The Stack v3: 114TB Largest Open Source Code Dataset(13 posts)→
More from Research
- Token Collapse: Study Finds Graph Soft Prompting Tokens in LLMs Fail to Encode Structure — Sapienza · 2026-10-27
- UniAction: unified action conditioning lets one world model handle mixed action types — ZeYanjie · 2026-10-27
- Infini-AI Lab open-sources Hermit, a framework for agent harness evolution and continual learning — BeidiChen · 2026-10-27
- Meta FAIR's Self-Direction turns agent failures into reusable LoRA skills, +13.8pp on Terminal-Bench — karen_ullrich · 2026-10-27
- DONIC hits 86.79% on bimanual dexterous tracking, crushing prior SOTA's 9.43% — liuziwei7 · 2026-10-27
- Why don't more LLMs ship 10M-token context? A researcher asks about attention tradeoffs — agarwl_ · 2026-10-27