Apple reframes video caption quality evaluation via multiple-choice QA

Apple ML Research · rss · 2026-09-11

Apple ML Research proposes evaluating video captions through information fidelity rather than reference matching. Existing metrics penalize valid "one-to-many" paraphrases; the new approach tests caption quality via multiple-choice question answering, enabling fine-grained assessment of coverage and accuracy for VLLM captioning.

Original post →

More from Research

Research channel →