UK AISI says leading open-weight models are now only 4–7 months behind frontier models in cyber ability
新智元 · wechat · 2026-07-21
The UK’s AISI published a public report quantifying the cyber gap between leading open-weight and closed frontier models for the first time: roughly **4–7 months** behind, down from **6–10 months** in last year’s internal tests. - AISI used two evaluation tracks: 70 narrow cyber tasks and a multi-step **CyberRange** simulating enterprise intrusion chains. - **GLM-5.2** roughly matched **Opus 4.6** on narrow tasks and **Opus 4.5** on CyberRange; **DeepSeekV4-Pro** tracked close behind on both. - The cost gap is even larger than the capability gap: on the same CyberRange test, **Opus 4.5/4.6** cost about **$85** per run, **GLM-5.2** about **$46**, and **DeepSeekV4-Pro** just **$1.19**. - AISI argues that once open weights are released, the capability is permanently out in the wild, while defensive tools still require each team to invest time and money. - The report’s policy implication is sharper than the raw numbers: decision-makers may need to define which capability levels should never be released as open weights.
More from AGI Musings
- People argue about Homer as if everyone had read the same Iliad and Odyssey — RachelVT42 · 2026-07-21
- AI will take your job in 12–18 months, the post argues — rand_longevity · 2026-07-21
- Distillation alone is unlikely to explain the rise of Chinese AI models, says Reddit post — pier4r · 2026-07-21
- New papers say scaffolds explain only 1.5% of agent performance variance — gerardsans · 2026-07-21
- Larry Fink says China is ahead in the AI energy race, citing 100 GW nuclear buildout — rohanpaul_ai · 2026-07-21
- Jamie Dimon says bureaucracy, not AI, is the real system crushing intelligence — r0ck3t23 · 2026-07-21