CritPt v2 score jump mostly from revised challenges, not tool access, says Artificial Analysis
ArtificialAnlys · x · 2026-10-23
Artificial Analysis clarifies that CritPt v2 scores aren't directly comparable to v1: GPT-6 Astra (max) went from 32% on v1 to 83% on v2. Their testing shows most of the increase comes from the revised challenges, with code-execution tool access adding a smaller gain. With leading models above 80%, v2 leaves less headroom at the frontier than v1 did.
Related event: CritPt v2 Score Gains Driven by Prompt Revisions, Not Tooling(2 posts)→
More from Models
- PHP Foundation reveals Anthropic's Claude cyber model scanned PHP, validated with OpenAI's Daybreak Red — saibharadwaj · 2026-10-23
- Sophont's Holon-S1 predicts genes and biomarkers from routine pathology slides — iScienceLuvr · 2026-10-23
- Microsoft's AI diagnostic system beats doctors on hard cases in Science study, but credit may go to underlying models — TechCrunch AI · 2026-10-23
- Doc parsing lite mode scores 75.1 vs Azure Read's 42.3 on OmniParseBench, dominates non-Latin scripts — VikParuchuri · 2026-10-23
- Datalab open-sources Indra OCR: a 1M-parameter model that beats PaddleOCR on CPU — VikParuchuri · 2026-10-23
- The inside story behind OpenAI's million-dollar math proof — scientificamerican · 2026-10-23