TifinaghBench launches: top AI model scores just 29.9/100 on Amazigh language understanding
gekobraa · x · 2026-11-01
ItriCloudLabs launched TifinaghBench, testing whether AI models actually understand the Amazigh language of North Africa. The first leaderboard ranks 8 models across 3 language varieties, with the best score only 29.9/100, exposing a major gap for low-resource languages. More models are being tested and the leaderboard will keep growing as an ongoing project.
More from Research
- New talk: How to retarget human behavior to humanoid robots — notmahi · 2026-11-01
- CrowdGPT v2.6: crowdsourced LLM training adds 4.5B tokens in 6 days — Vxtzq1 · 2026-11-01
- AI agent performs first end-to-end epilepsy treatment in a mouse, from gene therapy design to robotic brain surgery — Distinct-Question-16 · 2026-11-01
- Interactive Explainer Demystifies Gated DeltaNet, the Fixed-State Linear Attention Behind Recent Models — CatAstro_Piyush · 2026-11-01
- BooBench: A Halloween Benchmark That Scares LLMs and OCR Tools Into Character-Repeating Meltdowns — xennygrimmato_ · 2026-11-01
- Interactive visualizer lets you zoom into Esperanto's ET-SoC-1 AI chip, down to FMA instructions — yaroslavvb · 2026-11-01