GPT-6 Sol Tops Vercel's DeepSecBench With Highest Score at 20% of Runner-Up's Cost
cramforce · x · 2026-09-26
Vercel's DeepSecBench, which measures how well models find security vulnerabilities in application code (recall + precision via the deepsec cyber harness), now has GPT-6 Sol (xhigh) at the top of the Pareto frontier: 40.91 score, 96% precision, $12.76 total cost. Runner-up GPT-6 Astra (xhigh) scored 37.79 but cost $63.70. Claude Opus 5 (max) came fourth at 32.44 with a steep $127.93 and only 88% precision. OpenAI models currently hold both the quality and cost edge on code vuln discovery.
More from Models
- Micius-Flash: 27B Multimodal Model for Hardware and Semiconductor Agents — zhiman-ai · 2026-11-11
- Baidu says RSI auto-optimized ERNIE inference, 6.24x decode speedup on Kunxin P800 — xiaohu · 2026-11-11
- Baidu's ECHO: multi-token prediction reusing the last layer as a drafter — xiaohu · 2026-11-11
- ERNIE 5.5 Flash Preview: 280B-param multi-router MoE activating only 14B per token — xiaohu · 2026-11-11
- ERNIE 5.5 recreates the Pelican test: 117-second animation drawn frame-by-frame in Python — xiaohu · 2026-11-11
- 35,000+ Grok-built apps exposed patient data, plaintext passwords, and sales pipeline — The Decoder · 2026-11-11