AI2 Releases Mangosteen: A High-Quality Thai Pretraining Corpus

allen_ai · x · 2026-08-27

AI2 released Mangosteen, a 47B-token Thai pretraining corpus. Models trained on it matched or beat Thai LLMs trained on larger web datasets after filtering duplicates and low-quality text. These gains held with larger models. AI2 emphasizes making tools like Dolma open to help researchers adapt to specific languages and communities.

Related event: Ai2 Helps Build 47B-Token Thai Corpus Mangosteen(2 posts)→

Original post →

More from Models

Models channel →