Arena Introduces Factuality Leaderboard
WeijiaShi2 · x · 2026-07-16
Arena has incorporated factuality into its model rankings, with the new leaderboard displaying a weighted result of "human preference + factuality".
The team explained that they randomly sample battle conversations, extract verifiable web-based claims, and fact-check them individually. To do this, they have already annotated over 2 million LLM claims, with 1.3 million+ from Text Arena and 700,000 from Search Arena.
Results mentioned in the quoted tweet: GPT-5.6 holds a significant lead in factuality, followed closely by Grok-4.5; Opus-4.8 scored higher than Fable-5, while Muse-Spark lost notable points as the factuality weight increased.
Related event: Arena Adds Factuality to Model Rankings(12 posts)→
More from Models
- OpenAI is reportedly briefing U.S. lawmakers on its next model family — kimmonismus · 2026-07-22
- Muse Spark 1.1 lands at 1495 on Text Arena with standout agentic-coding price performance — ycombinator · 2026-07-22
- Advanced AI Models Are Becoming Impossible to Plug and Play — emollick · 2026-07-22
- Google Gemini's AI Problem: No Leading Model for Core Workloads — bindureddy · 2026-07-22
- Model Offers 1M Token Context Window at Just $0.33/1M Tokens — MickeySteamboat · 2026-07-22
- Google says information agents are coming to AI Pro and Ultra this summer — gaganghotra_ · 2026-07-22