For years, AI model rankings have largely been a popularity contest. Users vote on which response they prefer, and those votes determine who sits at the top. Arena.ai just changed the rules of the game by weaving factual accuracy into the equation.

The platform’s new factuality-adjusted leaderboard applies a default weight of 25% for factual accuracy alongside traditional human preference votes. The results have been dramatic: OpenAI’s GPT-5.5 rocketed up 13 positions to claim the seventh spot, while Meta’s Muse Spark cratered 13 places down to number 20. Anthropic’s Claude Fable 5 slipped to the second position.

How the new system actually works

Arena.ai’s approach extracts what it calls atomic, verifiable claims from each model’s response. Every response gets broken down into its smallest provable statements, and search agents then assign calibrated truth probabilities to each one. Text responses average about 5 verifiable claims each, while Search responses clock in at around 10.

The platform combines the outcomes of these “factuality battles” with traditional user preference votes using a Bradley-Terry model. The whole thing runs on a massive dataset: over 2 million labeled claims drawn from more than 130,000 Text Arena battles and 40,000-plus Search Arena battles.

Between 76% and 88% of battles include at least one verifiable claim, and the true-claim rates across models hover between 87% and 89%.

Winners, losers, and what the gap reveals

OpenAI’s models generally maintained or improved their standings as factuality weighting increased. GPT-5.5’s 13-position surge suggests the model was being systematically undervalued by pure preference voting. Muse Spark’s tumble from seventh to twentieth is particularly striking: a model that users consistently preferred in head-to-head matchups turned out to be less reliable when its claims were actually verified.

Why this matters beyond the AI leaderboard

As model outputs grow more sophisticated, human evaluators are increasingly unable to spot factual errors embedded in fluent, confident-sounding text. Arena.ai essentially acknowledged that human judgment alone is no longer sufficient to rank these systems.

For companies building products on top of these models, the model powering their backend has now been publicly graded on accuracy with a dataset of 2 million claims across regulated industries like finance, healthcare, and legal services, where factual errors carry direct consequences.