Perplexity launches Q2D-Web benchmark and leaderboard for agentic web search retrieval
andrewgwils · x · 2026-09-10
Perplexity and researcher Deniz Yarats released Q2D-Web (Query2Doc-Web), a new benchmark and public leaderboard evaluating embedding models for retrieval in agentic RAG systems. It measures large-scale web search performance using agent-reformulated queries, filling a gap left by traditional retrieval evals. Paper, blog, and leaderboard are live.
Related event: Perplexity Releases Q2D-Web, an Open Benchmark for Agentic RAG Retrieval(10 posts)→
More from Research
- JockeyBench uses Japanese horse racing to test LLM agents — all betting strategies lose money — Zhongwei Xie · 2026-10-27
- Stanford's PaperFormalizer turns research papers into Lean-verified versions with author in the loop — StanfordUniversity · 2026-10-27
- Cohere's Invent-A-Dataset paper: zero-seed synthetic data beats frontier APIs on quality and diversity — idanbeck · 2026-10-27
- Hugging Face TRL makes score centering + masked importance sampling default in async GRPO — _lewtun · 2026-10-27
- EMNLP 2026: sub-billion-parameter LMs show superhuman entity tracking, human-like fleeting memory — GretaTuckute · 2026-10-27
- 10-year study documents first 'unnatural gradient' phonotactic restriction in Tarma Quechua — begusgasper · 2026-10-27