INCLUDE-2.0 benchmark released: 91 languages, 22 scripts, 86 countries of local-exam questions
ABosselut · x · 2026-10-26
INCLUDE-2.0 has been released — an expanded multilingual benchmark that evaluates models' regional factual knowledge using questions from local exams across 91 languages, 22 scripts and 86 countries. The work is being presented in an EMNLP Oral by Maria Grandury's team.
More from Research
- Sakana AI hosts Tokyo RSI symposium: AI Scientist in Nature, Schmidhuber keynotes — RobertTLange · 2026-10-26
- HuggingFace's Carbon-X Spots Pathogenic Splice Variant Where Gemini 3.8 Flash Misreads the Gene — LoubnaBenAllal1 · 2026-10-26
- ETH Zurich paper: dynamic evaluation allocation matches 10x-budget model rankings — zouharvi · 2026-10-26
- DuoLM: Fast LLM-Based Personalized Recommendation via Compact Encoder-Ranker — GoogleDeepMind · 2026-10-26
- DISC Learns to Combine Time-Series Dataset Similarity Metrics for Transfer Prediction — Yen-Ku Liu · 2026-10-26
- Adobe's SliderEdit++ Improves Slider-Based Image Editing by 18.5% with New SlideBench — Arman Zarei · 2026-10-26