INCLUDE-2.0 benchmark evaluates regional knowledge across 91 languages and 86 countries
ABosselut · x · 2026-10-26
INCLUDE-2.0 has been released and will be presented as an oral at EMNLP 2026 in the Resources and Evaluation session.
- The expanded multilingual benchmark tests models' regional factual knowledge using questions from local exams
- It spans 91 languages, 22 scripts and 86 countries
- The team invites discussion of the paper and collaboration on future INCLUDE versions
Related event: INCLUDE-2.0 Benchmark Released Covering 91 Languages(2 posts)→
More from Research
- Purdue's GPS-free autonomous drone tracks runners through dense forests using on-chip LiDAR AI — KordingLab · 2026-10-26
- LLM drug recommendations converge on single products, averaging 97.5% of first picks — EricTopol · 2026-10-26
- Papers with Code goes open-source under Apache 2.0 license — NielsRogge · 2026-10-26
- Stanford NLP's COLM 2026 keynote: interpretability shifts from probing to causal steering — stanfordnlp · 2026-10-26
- USTC paper: matrix multiplication exponents below 9/4 would also speed up lattice sieving — jedisct1 · 2026-10-26
- lm-watermarking: official open-source implementation of LLM text watermarks — adnan_hashmi · 2026-10-26