Unverified: third-party Scry claims 71.8% vs Gemini's 66.1% on DeepSearchQA
AaronBergman18 · x · 2026-09-06
An X account (XyraSinclair, retweeted by AaronBergman18) claims its deep-search product Scry beat Google's Gemini Deep Search Agent on DeepSearchQA, scoring 71.8% against 66.1%.
DeepSearchQA is a 900-prompt arXiv benchmark from a Google team for evaluating deep research agents on multi-step information-seeking across 17 fields. Tasks are causal chains testing fragmented-information collation, deduplication/entity resolution, and stopping-criteria reasoning in open search spaces. The paper finds even state-of-the-art models struggle to balance recall with precision, with failure modes like premature stopping and hedging.
Note: the comparison is a third-party claim, not independently verified.
More from Models
- Meta researcher: horrifying infra, not talent, is why OSS can't catch closed frontier — A_K_Nain · 2026-10-23
- TypeSafe's Jev: a "Decision Model" LLM That Returns Floats at $0.042/M Input Tokens — ariG23498 · 2026-10-23
- Microsoft's MAI-Base-2 scaling ladder pegs the L42 run at ~1.8×10^23 FLOPs — teortaxesTex · 2026-10-23
- Local model agentic coding benchmark: 27B matches 125B, tool-calling is the lever — Joralk_ · 2026-10-23
- NVIDIA open-sources PersonaPlex-7B, a full-duplex voice AI model that listens and talks simultaneously — solyarisoftware · 2026-10-23
- NVIDIA's KumoRFM-2: a foundation model that predicts churn, fraud and demand straight from relational databases — solyarisoftware · 2026-10-23