Q-CARE: A Reference-Free RAG Evaluation Framework Accepted to COLM 2026
_reachsumit · x · 2026-08-13
The paper introduces Q-CARE, a reference-free framework for evaluating Retrieval-Augmented Generation (RAG). By decomposing queries into sub-queries and answers into atomic claims, it enables fine-grained assessment based on query coverage and claim verifiability.
On a human-annotated benchmark spanning eight datasets, Q-CARE achieves higher correlation with human judgments than existing metrics like RAGEval and RAGChecker, proving its effectiveness as a reliable, automated evaluation tool.
More from Research
- Navier-Stokes partial regularity machine-checked in Lean by 50-agent swarm in 36 hours — RexDouglass · 2026-09-22
- Small neural programs fail simple tasks; researcher says test-time compute is unavoidable — yuntiandeng · 2026-09-22
- TexF: Surface-Aligned Texture Fields move mesh texture compression beyond UV maps — ssh4net · 2026-09-22
- EMNLP 2026 tutorial on LLM tokenization research set for October 28 in Budapest — PontiEdoardo · 2026-09-22
- 27 Fields Medalists Warn AI Solving 100+ Open Math Problems Could Hollow Out the Field — stevenstrogatz · 2026-09-22
- PIR lie-detector reads LLM internal states to expose hidden knowledge at 0.70-0.87 accuracy — Hiskias Dingeto · 2026-09-22