MameLoshnLM: First Open-Source 8B LLM and Benchmark for Yiddish
Yiddish-NLP · hf · 2026-08-07
The Yiddish-NLP team released MameLoshnLM, the first open-source 8B-parameter language model built specifically for Yiddish. Addressing the scarcity of reliable digital resources and the prevalence of noisy, machine-translated text in existing datasets, the team also introduced Oytser, a high-quality pretraining corpus, and Kashes, a multi-task benchmark.
Using these resources, the researchers continued pretraining Llama 3.1 8B. MameLoshnLM outperformed open baselines of similar scale across tasks in the Kashes benchmark, including translation, linguistic analysis, and information extraction.
Beyond quantitative gains, the model better captures language-defining lexical and morphological patterns. The research highlights a broader failure mode of noisy web-scale multilingual data for low-resource languages, providing a practical template for developing models for historically rich but digitally underrepresented languages.
More from Models
- Opus 5.5 turns heads with surprisingly polished vertical video demo — FinanceYF5 · 2026-10-16
- Astra 6.1 may arrive before end of month, reads dev's 'we are cooking' tease — haider1 · 2026-10-16
- Open-source OCR model indra-ocr trends on Hugging Face with CPU support — datalab-to · 2026-10-16
- Xiaohongshu's Vela 35B turns anonymized user behavior into supervision, gains +11.5 on VelaBench — AdinaYakup · 2026-10-16
- KOL: No better model than Anthropic's Opus right now, its magic is back — kimmonismus · 2026-10-16
- Users blast Gemini in Chrome's 'draconian' usage caps: memory costs 2-4% per use — North-American · 2026-10-16