Perplexity's Q2D-Web: 190M Documents, 70k Agent-Rewritten Queries for Retrieval Eval
CShorten30 · x · 2026-09-10
Perplexity team members are amplifying the Q2D-Web benchmark: 190M documents, 70k agent-rewritten queries and deep annotations, designed to evaluate large-scale web retrieval in agentic RAG systems where existing benchmarks fall short, with a public leaderboard.
Related event: Perplexity Releases Q2D-Web, an Open Benchmark for Agentic RAG Retrieval(10 posts)→
More from Research
- AutoResearch agent produces weird 'forking' loss curves, and the team dug into the science — ZimingLiu11 · 2026-10-27
- No π0 weights changed: Motoniq layer lifts real-robot precision fitting from 0/10 to 9/10 — hbouammar · 2026-10-27
- MICE paper pushes cross-encoders from re-ranking to end-to-end retrieval — antoine_chaffin · 2026-10-27
- JockeyBench uses Japanese horse racing to test LLM agents — all betting strategies lose money — Zhongwei Xie · 2026-10-27
- Stanford's PaperFormalizer turns research papers into Lean-verified versions with author in the loop — StanfordUniversity · 2026-10-27
- Cohere's Invent-A-Dataset paper: zero-seed synthetic data beats frontier APIs on quality and diversity — idanbeck · 2026-10-27