Disabling downloads isn't a fix: CWE-bench requires patches to preserve functionality
krishnan · x · 2026-11-02
Krishnan explains CWE-bench's repair contract: a patch passes only if it blocks the tested exploits AND the repo's existing functionality tests still pass. Disabling downloads may stop path traversal, but it also removes the very service the file server exists to provide — that is not a repair.
Related event: CWE-bench Benchmarks AI Security Agents and Fix Validity(7 posts)→
More from Safety
- New study examines how developers actually supervise autonomous coding agents — burkov · 2026-11-02
- AI anti-regulation super PAC with $100M funding flounders as pro-safety PACs gain ground — ShakeelHashim · 2026-11-02
- Cisco finds Claude-powered infostealer that routes to Kimi K2 to dodge AI guardrails — Hesamation · 2026-11-02
- Grok to embed invisible watermarks in AI-generated text from Nov 7 to comply with EU AI Act — Polymarket · 2026-11-02
- SemiAnalysis: 30.3GW of planned 2028 US data center capacity at risk of pause after midterms — Eliv_nurotic · 2026-11-02
- Lenovo's 'encrypted' fingerprint drive is an unencrypted SD card in disguise; AI-assisted audit finds backdoors in others — jedisct1 · 2026-11-02