NVIDIA Nemotron 3 Embed 8B tops Perplexity's new Q2D-Web agentic RAG benchmark
JFPuget · x · 2026-09-11
Perplexity introduced Q2D-Web (Query2Doc-Web), a benchmark and public leaderboard for evaluating retrieval in agentic RAG systems, built on 190M web documents and nearly 70K agent-reformulated queries across 10 languages. NVIDIA announced its Nemotron 3 Embed 8B ranks #1 in combined nDCG@10 on the benchmark, the first large-scale web retrieval eval focused on agent-reformulated queries.
More from Models
- Nanbeige4.3-33B benchmarked: 59 tok/s single stream, ~1,060 tok/s across 64 concurrent runs — MaziyarPanahi · 2026-10-26
- Only 2 of 25 full ChatGPT rewrites flagged 100% AI by detectors — paulnovosad · 2026-10-26
- Qwen 4 Reportedly Spotted in the Arena, Hints at Alibaba's Next-Gen Model Testing — AIFlow_ML · 2026-10-26
- Nathan Lambert's first open models lecture: distillation, risks and the ecosystem explained — natolambert · 2026-10-26
- Nanbeige 4.3-33B flops real-world test: zero compilable output vs Qwen — julianharris · 2026-10-26
- Claude's safety classifier blocks SS7 defense research, pushing a security dev to an abliterated GLM — l4rz · 2026-10-26