CAIS releases HLE-Diamond, an updated Humanity's Last Exam benchmark
socoolandawesome · reddit · 2026-09-24
CAIS has released HLE-Diamond, an updated version of the Humanity's Last Exam benchmark. The announcement came via its X account, with details on the lastexam.ai blog (lastexam.ai/blog/hle-diamond). HLE is a well-known benchmark for testing frontier models on extremely hard human expert questions, and this refresh provides a new yardstick for evaluating model limits.
Related event: CAIS Releases HLE-Diamond Benchmark, GPT-6 Astra Tops at 60.6%(3 posts)→
More from Research
- One picture each: gradient descent and backprop explained without arithmetic — alfcnz · 2026-09-24
- Neural net series: multi-layer nets and why cross-entropy and squared error share the same gradient — alfcnz · 2026-09-24
- Teaching Thread: From Perceptrons to Hidden-Layer Representations in Driving — alfcnz · 2026-09-24
- Simulated fly on LSD: connectome wired with eyes shows T4/T5 activity up 10–20% — Merzmensch · 2026-09-24
- Anthropic's first biology lab result draws scrutiny: only ~4 parallel agents and no wet-lab details — basedjensen · 2026-09-24
- Predict rates, not yield: ML kinetic maps explain nickel cross-coupling failures — bravo_abad · 2026-09-24