NeurIPS Spotlight Paper DCI: Ditching Top-k Retrieval for grep-Style Agentic Search
stanfordnlp · x · 2026-09-25
Stanford NLP researcher Dongfu Jiang announced that "Beyond Semantic Similarity" (DCI) was accepted to NeurIPS as a Spotlight. The paper argues that top-k retrieval is a compressed interface that bottlenecks agentic search: exact lexical constraints, sparse clue conjunctions, and multi-step hypothesis refinement are hard to express through a fixed semantic-similarity retriever, and evidence filtered out early can't be recovered.
The team's DCI-Agent drops the embedding model, vector index, and retrieval API entirely — instead letting the agent operate directly on large-scale local corpora via terminal-style tools like grep, read, bash, regex, and lightweight scripts. The result: higher accuracy at lower token cost.
Key points:
- NeurIPS Spotlight, co-authored by Wenhu Chen, Jimmy Lin, Yejin Choi, James Zou, Jiawei Han and others
- Code and paper are openly available
- Premise: as agents get stronger at planning, coding, and tool use, retrieval should expose the raw corpus rather than a retriever's compressed view
Related event: DCI Paper Named NeurIPS 2026 Spotlight: grep Beats top-k Retrieval(3 posts)→
More from coding & agent
- Perplexity CEO shows agent building browser-playable 3D zombie shooter in hours with zero 3D assets — AravSrinivas · 2026-11-11
- The complete harness engineering roadmap: how OpenAI shipped ~1M lines with zero hand-written code — blaizedsouza · 2026-11-11
- Micius-Flash: 27B Multimodal Model for Hardware and Semiconductor Agents — zhiman-ai · 2026-11-11
- Viral 'the harness is the machine' thread touts unverified Claude Fable/Mythos 5.2 9-equation architecture — blaizedsouza · 2026-11-11
- Compaction creates a new failure mode for coding agents: critical bug details can vanish mid-fix — blaizedsouza · 2026-11-11
- What 40+ coding-agent harnesses do between your prompt and the model, dissected — blaizedsouza · 2026-11-11