Comparing Large Models' Practical Cybersecurity Capabilities
daniel_mac8 · x · 2026-07-17
The tweet cites results from AISI's (AI Safety Institute) cybersecurity range test "The Last Ones." Data shows that GLM-5.2 matches the performance of Claude Opus 4.5 released about 7 months ago, while DeepSeek V4-Pro lags behind Claude Sonnet 4.5 from the same period. The author believes such safety tests are the most objective benchmarks for assessing models' actual destructive power in cyberspace.
Related event: AISI says open models narrow the cyber-range gap(6 posts)→
More from Models
- Together AI sits down with Meta to explain Muse Spark Open — togethercompute · 2026-10-27
- GPT-6.1 Terra hits ~60% on Agents' Last Exam at $1/task, 9x cheaper than Opus 5.5 — ChrisGPT · 2026-10-27
- ChatGPT keeps telling tech-support users to email 404 Media's Jason Koebler — petrusenko_max · 2026-10-27
- GPT-6.1 Terra called the awkward middle tier, priced at half of GPT-6.1 Sol — cedric_chee · 2026-10-27
- Mystery model "Terra" scores 48 on Artificial Analysis index with no public API — haider1 · 2026-10-27
- GPT-6.1 Terra (Max) Appears on Artificial Analysis Scoring 48 — theanonymousone · 2026-10-27