Mythos Security Eval: Top Performance at 15x Cost vs Competitors
andreamichi · x · 2026-09-02
Security firm depthfirst evaluated the closely watched cybersecurity model Mythos on the dfbench suite. Mythos achieved a leading 69% detection recall and 24.5% precision on validation tasks, outperforming GPT 5.6 Sol (65.7%) and dfs-large1 (62.2%). However, Mythos costs an estimated $99.19 per task, significantly higher than GPT 5.6 Sol ($43.37) and dfs-large1 ($6.77). At the same spend, competitors can analyze roughly 2x and 15x as many scopes respectively.
More from Models
- Cohere's Embed 5 Fast beats Google's EmbeddingGemma 2 on 95% of 163 benchmark datasets — krypticmouse · 2026-10-18
- MOSS SFT vs Flux 3 Klein vs SD 3.0: Same-Prompt Comparison Exposes SD3's Age — ZootAllures9111 · 2026-10-18
- Quick take: GPT-6 matches Opus 5.5 at coding, far ahead at computer use — _vztu · 2026-10-18
- Open models now above Sol-level, outpacing expectations as community awaits V4.1 Pro — yacineMTB · 2026-10-18
- Codex took 3 days, Opus 5.5 nailed it in an afternoon — banned user's video protest — dotey · 2026-10-18
- Yacine MTB: Users will remember how Anthropic treated them once intelligence proliferates — yacineMTB · 2026-10-18