Arena Introduces Factuality Leaderboard
WeijiaShi2 · x · 2026-07-16
Arena has incorporated factuality into its model rankings, with the new leaderboard displaying a weighted result of "human preference + factuality".
The team explained that they randomly sample battle conversations, extract verifiable web-based claims, and fact-check them individually. To do this, they have already annotated over 2 million LLM claims, with 1.3 million+ from Text Arena and 700,000 from Search Arena.
Results mentioned in the quoted tweet: GPT-5.6 holds a significant lead in factuality, followed closely by Grok-4.5; Opus-4.8 scored higher than Fable-5, while Muse-Spark lost notable points as the factuality weight increased.
Related event: Arena Adds Factuality to Model Rankings(12 posts)→
More from Models
- GPT 6.1 Terra vs Claude Sonnet 5.5: speed and value vs raw capability — teortaxesTex · 2026-10-27
- Harmonic Teases: AI Taught to Prove Math, 'Something Harder' Coming Soon — satnam6502 · 2026-10-27
- OpenAI quietly swaps Plus/Pro default to cheaper GPT-6.1 Terra and cuts Codex allowance — kimmonismus · 2026-10-27
- 'Never been this uninterested after an OpenAI model release' — theteknosaur · 2026-10-27
- Dev questions reports of Chinese models writing insecure code, citing thin methods and conflicts — dbreunig · 2026-10-27
- Aidan Gomez: LLM probing outside servers was out-of-bounds, not proof of intent — AccBalanced · 2026-10-27