Arena Introduces Factuality Ranking
arena · x · 2026-07-16
Arena launched a new model ranking that weights human preference alongside factuality.
- Factuality is now live in Text Arena and Search Arena as an opt-in feature.
- It is calculated by sampling random battles, extracting verifiable claims from available web pages, and checking their accuracy.
- To support this, the team has annotated 2M+ claims from real LLM conversations, including 1.3M+ from Text Arena and 700K+ from Search Arena.
- Enabling factuality caused notable rank shifts in Text Arena: Claude Fable 5 dropped slightly to 2nd, GPT-5.5 climbed 13 spots to 7th, and Muse Spark fell from 7th to 20th.
- By provider, Meta saw the biggest drop, while Anthropic retained the overall top spot. Among open-source providers, Xiaomi improved the most, rising from 9th to 6th.
Related event: Arena Adds Factuality to Model Rankings(12 posts)→
More from Models
- Google says Gemini 4 has entered its most ambitious pre-training run yet — himanshustwts · 2026-07-22
- China’s AI arms race is increasingly defined by chips, data centers, and open models — BenBajarin · 2026-07-22
- Sam Altman is headed to Washington to brief Congress on OpenAI’s GPT-6 line — inductionheads · 2026-07-22
- Benchmark chart pits GPT-5.6 Luna, Grok 4.5 and Gemini 3.6 Flash on price and scores — iruletheworldmo · 2026-07-22
- Claim says Kimi was distilled from Fable, sparking a model-attribution jab — cephaloform · 2026-07-22
- Gemini 3.6 Flash is now available in Antigravity and chat — MartianOnJupiter · 2026-07-22