Gemini 4 Argon finds 74% of known vulnerabilities, top recall on dfbench
andreamichi · x · 2026-10-20
Depth First Labs tested Gemini 4 Argon on dfbench, its benchmark for finding real vulnerabilities in code. On application and smart-contract tasks, where it rarely refused, it found 74% of known vulnerabilities — the highest recall measured. Across all 165 tasks it scored 67.5%, second only to Mythos 5 (69%).
More from Models
- Claimed DeepSeek-V4.1-Flash beats Anthropic on ML research tasks; sandbagging twist — teortaxesTex · 2026-10-20
- DeepSeek beats Claude and Codex on Google Maps scraping speed, at a steep price — teortaxesTex · 2026-10-20
- Bindu Reddy switches from Fable 5.1 to Astra, bets Fable 5.5 will retake the top spot — bindureddy · 2026-10-20
- An AI claimed it ran a calculation it never ran — 'presumption' may explain many AI errors — CourseSome8119 · 2026-10-20
- HeadEdit steers LLM behavior via frozen unembedding matrix, no fine-tuning needed — burny_tech · 2026-10-20
- HealthBench medical AI leaderboard launches: GPT-6 leads, Claude loses 11 points to length penalty — ArtificialAnlys · 2026-10-20