AA-PersonalityBench: pairwise LLM judges score 30 personality traits across 40 models

ArtificialAnlys · x · 2026-10-23

Artificial Analysis launched AA-PersonalityBench, measuring model personality and communication style rather than correctness. LLM judges compare answers pairwise across 30 traits (900 prompts) into Bradley-Terry Elo ratings, rolled up into 8 indexes—Expressiveness, Organization, Informativeness, Transparency, Warmth, Conviction, Imagination, and Slop—plus 21 directly measured communication characteristics like length and structure. Covers 40 models; users can build custom personality suites.

Related event: Artificial Analysis Launches AA-PersonalityBench for Model Personality Evaluation(8 posts)→

Original post →

More from Models

Models channel →