The Stack v3 becomes the largest open code dataset at 114 TB and 5T tokens
soldni · x · 2026-07-24
The Stack v3 has been released as the largest open code dataset so far: 114 TB, 770 languages, 224M repositories, and about 5T deduplicated and filtered source-code tokens.
What changed from v2
- v2 (2024): 68 TB raw, filtered down to 2 TB / 550B tokens, covering 618 languages.
- v3 (2026): 114 TB raw, expanded to 770 languages and 224M repositories.
- The release claims no restrictively licensed code is included.
This is a major dataset-scale jump for open code pretraining and code research.
Related event: Hugging Face Releases The Stack v3: 114TB Largest Open Source Code Dataset(13 posts)→
More from Research
- 3D ResNet Paper Crosses 3,000 Citations Eight Years After CVPR 2018 — HirokatuKataoka · 2026-09-11
- Sample selection and ordering matter a lot in LLM training: DataFlex makes data scheduling dynamic — Puzzleheaded_Box2842 · 2026-09-11
- Jeff Heaton's Intro to the Math of Neural Networks eBook Is Free to Download — blaizedsouza · 2026-09-11
- Mathematician Daniel Litt Launches Problem Repo to Track Human vs AI Progress: 15 Problems, 1 Solved — littmath · 2026-09-11
- Open ECDSA.fail challenge uses AI agents to shrink Shor's-algorithm quantum circuits for Bitcoin keys — StefanoGogioso · 2026-09-11
- Alex Townsend posts 200 open problems in numerical linear algebra for humans and AI agents — IgorCarron · 2026-09-11