New AA Index v5 benchmarks hit open models hard; Chinese labs to catch up
teortaxesTex · x · 2026-10-29
Open models took a big hit from new AA Index v5 benchmarks (TB-Sci, HLE-Diamond, FrontierCode). Commenters say these show where Chinese models still lag, note O/A has long optimized for such benchmarks, but expect Chinese labs to catch up soon.
More from Models
- Hypothesis: DeepSeek seeds on GPT data, and internal RL drives its more-extreme-than-GPT personality — teortaxesTex · 2026-10-29
- DeepSeek v5, v5-open and v5-next spotted in deepseek-harness code, launch may come this year — airesearch12 · 2026-10-29
- ChatGPT users report Computer history broken for weeks despite being on — RileyRalmuto · 2026-10-29
- You.com: agentic search failures are behavior problems, fixed in Nemotron 3.5 Lightning — RichardSocher · 2026-10-29
- How I AI agent bench: Grok Bot wins big at 93%, Claude Duet trails at 79% — lennysan · 2026-10-29
- DeepMind slammed for announcing models weeks before availability amid Gemini Xenon chatter — adonis_singh · 2026-10-29