Cisco's small security model scores 0.823 flagging risky files — drops to 0.000 on built code
shashib · x · 2026-10-08
Cisco Foundation AI, led by chief AI scientist Amin Karbasi, published September results for its small security models Antares-1B / Antares-350M, which run locally and point security teams to files tied to known bug types.
Key numbers:
- 0.823 score on open source code (1.0 = perfect file list), but 0.000 once the program is built.
- In a September 4 test across 500 cases from 290 real projects, the strongest system scored 0.229, with the largest Antares model at 0.223; a second test covered 95 real bugs.
The models ship via Hugging Face with a CLI tool that produces a human-readable file list and a code-review report, with all code staying on the team's own machines. Karbasi targets universities, research groups, nonprofits, and public-sector teams.
More from Models
- Claude Haiku 5.5 tops RamenBench: 45-min run, 420k tokens, $2.06 — a big leap over Haiku 4.5 — aitrendz_xyz · 2026-10-08
- Haiku 5.5 vs Opus 5.5, same prompt: 15 minutes vs over an hour, with Opus still ahead on quality — aitrendz_xyz · 2026-10-08
- Haiku 5.5 drops and devs are already building with it like it costs nothing — aitrendz_xyz · 2026-10-08
- After OpenAI's math breakthrough, few doubt LLM math capabilities anymore — burny_tech · 2026-10-08
- Best local storytelling model for an 8GB GPU? Reddit user seeks current gold standard — opUserZero · 2026-10-08
- Side-by-side test: Opus 5.5 'in a league of its own' vs Sonnet 5.5 for creative work — tobowers · 2026-10-08