Opus 5.5 dominates ValsAI's new Watershed cyber eval, breaking through at ~$17
teortaxesTex · x · 2026-11-11
ValsAI added Watershed to its CyberOffense eval, simulating a realistic AWS production setup (Kubernetes cluster, ECS fleet, real cloud identities/policies). Claude Opus 5.5 tops all three scenarios (77.1% avg) with 55.7/100 on Watershed vs GPT-6 Sol Daybreak's 36/100. Kimi K3 scored 0 on Watershed; GLM 5.3 Flash averaged just 18.3%. The cost curve shows Opus lagging early, then breaking through around $17 of spend — commentator teortaxesTex thinks it could saturate the range before $100.
More from Models
- Claude Fable 5.2 Finally Solves Origami Task That Stumped Earlier Versions — FinanceYF5 · 2026-11-11
- Frontier AI gains steady +16.5 ECI/year, Anthropic's Fable 5.2 takes the lead — sebkrier · 2026-11-11
- If Google keeps this pace, it will be the best AI lab by year's end — imjustnewatai · 2026-11-11
- Fish Audio's new voice model panned: full-duplex claims don't hold up, hype is paid — realmrfakename · 2026-11-11
- Claude autonomously finds evidence against claim that mitochondria run 10-15°C hotter — paraschopra · 2026-11-11
- Auto Ontology benchmark: Google Surf MCP 116/120 edges out NVIDIA 113/120 — GarrixMrtin · 2026-11-11