PentestBench Launches: 17-App Corpus for Testing LLM Web Vulnerability Hunting
hunarbatra · x · 2026-11-18
ananayarora's team launched PentestBench, an open-source benchmark with a 17-app corpus for testing how well different model and harness configurations find, chain, and verify vulnerabilities in modern web apps. They found web vuln hunting — often considered "easy" — still has a long way to go for AI.
Related event: PentestBench: Open Benchmark Tests LLM Web Exploitation Skills(2 posts)→
More from coding & agent
- tldraw office hands-on: sketch specs on a whiteboard together with agents — max__drake · 2026-11-18
- OpenAI DX engineer's article: turning GPT-6.2 Astra into a video editor with Codex — nickbaumann_ · 2026-11-18
- OpenAI says start daily coding with GPT-6.2 Sol: near-flagship scores at ~1/5 the cost — OpenAIDevs · 2026-11-18
- GPT-6.2 Astra tops Agents' Last Exam: +5.2 points at under one-third the per-task cost — OpenAIDevs · 2026-11-18
- LangSmith adds trace access controls so engineers debug agents without exposing sensitive data — LangChain · 2026-11-18
- LangSmith adds three controls for sensitive trace data access — LangChain · 2026-11-18