cESA and Pearmut: new tools for translation human evaluation at EMNLP
New work presented at EMNLP introduces cESA, a contrastive annotation protocol already used in WMT26 evaluations, and Pearmut, an open-source platform replacing Appraise to make translation human evaluation easier to run.
2026-09-14 ~ 2026-09-14 · 4 related posts
- Pearmut and two eval methods replace Appraise-era tooling at WMT, headed to EMNLP — zouharvi · 2026-09-14
- Pearmut: an open platform making human translation eval as easy as automatic eval — zouharvi · 2026-09-14
- cESA annotation protocol speeds up MT evaluation and is adopted by WMT26 — zouharvi · 2026-09-14
- cESA: judging multiple translations at once cuts human eval time and noise — zouharvi · 2026-09-14