AA releases cleaned AA-Omniscience v1.1 benchmark with recalibrated public subset
ArtificialAnlys · x · 2026-10-28
Artificial Analysis released AA-Omniscience v1.1, a cleaned version of its knowledge and hallucination benchmark: saturated and public-set questions removed, new questions added, and ambiguous or erroneous ones revised. Scores largely align with v1, averaging 2 points lower (median 0.6).
It also published a recalibrated public subset, AA-Omniscience-Public-v1.1, on Hugging Face, ensuring accuracy, hallucination rate and overall performance stay consistent between public and private sets.
More from Models
- Debate: Claude isn't 'lobotomized' — inference stack updates may shift old-model outputs — JasonBotterill · 2026-10-28
- AI labs near IPO, yet LLMs still produce 'astonishingly terrible prose' by default — GabGarrett · 2026-10-28
- Rebuttal: Kimi 3.1 Nears Fable on Frontier Code 2, Contradicting 'China Models Crushed' Claim — bookwormengr · 2026-10-28
- Open model Flint hits #2 trending on Hugging Face, team outlines next steps — josh_tobin_ · 2026-10-28
- Artificial Analysis Intelligence Index v5 widens open-weight gap from 3 to 12 points — ResearchCrafty1804 · 2026-10-28
- YacineMTB rails: even the best LLMs are 'complete dogshit' and he's tired of it — yacineMTB · 2026-10-28