Cohere Launches Multilingual Model Human Evaluation, Seeks Contributors
Cohere_Labs · x · 2026-08-01
Cohere Labs announced that its multicultural riddle benchmark project has entered the human evaluation phase, with over 61,000 model responses already evaluated.
The project is actively recruiting native speakers for subsequent evaluations, with a specific need for contributors in Arabic dialects (Morocco and Sudan). Participants can engage in human evaluation, benchmark testing, and result analysis, with opportunities to co-author the final publication.
Related event: Cohere's Multicultural Riddle Benchmark Enters Human Evaluation(2 posts)→
More from Research
- MIT's Neil Thompson: AI comes for tasks before jobs, and fixed costs favor big firms — bigdata · 2026-10-16
- UMD's PAIR framework bridges perception and action in VLA models via bridge tokens — Kaixi Feng · 2026-10-16
- CI-MSE offline metric hits -0.87 Spearman correlation with real robot task success vs weak raw MSE — chris_j_paxton · 2026-10-16
- Colossal Biosciences uses AI to decode genetic switches behind the extinct dodo — castrotech · 2026-10-16
- Colossal Biosciences uses AI to identify gene switches in dodo de-extinction push — castrotech · 2026-10-16
- Cheng Lou open-sources Handwired: hand-written weights turn code into training-free neural nets — dotey · 2026-10-16