NVIDIA Nemotron 3 Embed 8B tops Perplexity's new Q2D-Web agentic RAG benchmark
JFPuget · x · 2026-09-11
Perplexity introduced Q2D-Web (Query2Doc-Web), a benchmark and public leaderboard for evaluating retrieval in agentic RAG systems, built on 190M web documents and nearly 70K agent-reformulated queries across 10 languages. NVIDIA announced its Nemotron 3 Embed 8B ranks #1 in combined nDCG@10 on the benchmark, the first large-scale web retrieval eval focused on agent-reformulated queries.
More from Models
- DeepSeek V4 training details: RL beyond collapse, WSD schedule, 1M context over 10T tokens — stochasticchasm · 2026-09-11
- Neel Nanda replicates Astra system card: no-CoT reasoning jumps 1.75x over next-best models — NeelNanda5 · 2026-09-11
- OpenAI pauses Pro subscriptions due to overwhelming demand — Charuru · 2026-09-11
- Artificial Analysis isn't broken: self-funded benchmarks, $13k spent on one model — Antblue · 2026-09-11
- Claude checkpoint diagnostician jokes Opus 3 is 'the cure' after newer model quirks — repligate · 2026-09-11
- Hume's Voice Replication Leaderboard: most natural clone ranked 8th of 11 on identity — realmrfakename · 2026-09-11