ProgramBench Results: Opus 5 Leads, 0813 Emerges as Strongest Open Model
teortaxesTex · x · 2026-08-23
Interesting results from ProgramBench Vetted highlight the 'almost' metric (tasks passing >95% of tests). While Opus 5 still dominates, the 0813 version stands out as strictly the strongest open model on one of the few evals where this distinction is clear.
Related event: ProgramBench Results: Opus 5 Leads, 0813 Tops Open-Source Models(2 posts)→
More from Models
- OSVerify: LLM verification framework finds 18 issues across 11 OpenAI math preprints — james_y_zou · 2026-10-16
- New inference engine 'e' hits 10,500 tok/s on a single DGX Station — brandon_galang · 2026-10-16
- NVIDIA's Nemotron 3.5 Super VL hits CoreWeave: 12B-active multimodal MoE at $0.25/M input tokens — wandb · 2026-10-16
- Opus 5 might be a very deep model or use looping, commentator speculates — scaling01 · 2026-10-16
- GPT-6.1 Sol audit finds 6% of arXiv papers had false main theorems, down to 1.5% recently — nitarshan · 2026-10-16
- Nvidia-backed post-training pushes Nemotron 3.5 VL past frontier on dermatology diagnosis — LoganGrasby · 2026-10-16