LangChain releases WikiBench to evaluate codebase doc agents
LangChain · x · 2026-08-26
LangChain released WikiBench, a benchmark for evaluating OpenWiki, their open-source agent for generating and maintaining codebase documentation. WikiBench assesses wiki quality using questions grounded in the underlying codebase to measure if the documentation actually helps coding agents and if changes are improving the agent. It is built on Harbor, a framework for evaluating long-running tasks.
Related event: LangChain Open-Sources WikiBench to Evaluate Codebase Wiki Agents(4 posts)→
More from coding & agent
- Ex-DeepMind Eng Lead's AI Calling Agent Fo Cut Hang-Up Rate from 80% to 20-30% — julianweisser · 2026-10-16
- SPACE Open-Sources Its Sandbox Platform for Agentic Code Execution — marktenenholtz · 2026-10-16
- Cognition Launches Devin OnCall to Auto-Investigate Production Alerts — DevinAI · 2026-10-16
- Devin Oncall tops SREGym with 100% end-to-end success, auto-resolving production incidents — tianyin_xu · 2026-10-16
- Running a multi-model UI design arena: Paseo orchestrates four design drafts per model — vista8 · 2026-10-16
- Cortex A/B-tests coding-agent skills and rules by replaying developer corrections before keeping them — Samuele Giampieri · 2026-10-16