PentestBench: open-source benchmark tests LLMs on 761 planted web vulnerabilities across 17 apps

hunarbatra · x · 2026-11-17

OpenHack launched PentestBench, an open-source benchmark evaluating how well model+harness combos find, chain and verify vulnerabilities in real web apps.

Design

Early results (catalog F1)

LLM-driven security review dramatically outperforms traditional static rule tools in early runs.

Original post →

More from Safety

Safety channel →