CryptanalysisBench tests LLMs on 191 real cryptographic schemes
thegautamkamath · x · 2026-07-23
CryptanalysisBench tests whether LLMs can break 191 real cryptographic schemes
The paper introduces CryptanalysisBench, a benchmark at the intersection of AI, math, and cybersecurity.
- It evaluates whether LLMs can perform cryptanalysis on 191 real schemes drawn from past standardization efforts.
- The authors frame cryptanalysis as a key link between AI progress in math and cyber, with direct relevance to digital security.
- The work suggests that LLMs are increasingly capable of assisting with this kind of security analysis.
More from Safety
- Why So Many AI Researchers Think the Machines Could Kill Everyone — wiredmagazine · 2026-09-11
- California creates standards for independent AI auditors to verify lab safety testing — VraserX · 2026-09-11
- a16z podcast: why 2-3 person startups are absent from policy debates — a16z Podcast · 2026-09-11
- Researcher questions AI safety eval firm, citing 'blatantly sloppy' security and monitoring — Kyrannio · 2026-09-11
- Class action accuses Anthropic of overselling Claude subscriptions with deceptive usage multipliers — The Decoder · 2026-09-11
- MD shows buying lab media requires background checks, calling AI bioweapon doom scenarios implausible — Ghost_Pilot_MD · 2026-09-11