Patches are clues: giving Codex the patched binary lifts exploit rate from 10% to 25%

dawnsongtweets · x · 2026-11-12

From the CyberBinGym thread: on 20 matched tasks, giving Codex (GPT-5.6 Sol) the patched binary raised its exploitation success from 10% to 25% (2.5×) while lowering average cost per task. Even compiled, the patch diff tells the agent where to look — the core risk unpatched systems face during the 1-day window.

Related event: Dawn Song's Team Releases CyberBinGym: AI Can Exploit Real Vulnerabilities from Binary Patches Alone(9 posts)→

Original post →

More from Safety

Safety channel →