Skip to content
TheChatArchiveThe Chat Archive
Claudeclaude-3-5-haiku-20241022· AnthropicHugging Face LMArena Human Preference 140K

What is an Elo score?

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with Geminigemini-2.0-flash-001’s answer.
  1. User

    What is an Elo score?

  2. Claude Assistant

    An Elo rating system is a method for calculating the relative skill levels of players in two-player games, originally developed by Arpad Elo for chess, but now used in many competitive domains. Here's a breakdown:

    Key characteristics:

    • It's a comparative rating system where players gain or lose points based on match outcomes
    • The system assumes that a higher-rated player is more likely to win against a lower-rated player
    • Points exchanged depend on the expected probability of winning and the actual result

    How it works:

    1. Players start with an initial rating (often 1500 in chess)
    2. When a player wins against a higher-rated opponent, they gain more points
    3. When a player loses to a lower-rated opponent, they lose more points
    4. Draws result in smaller point exchanges

    Common applications:

    • Chess rankings
    • Online competitive games like League of Legends
    • Sports team rankings
    • Professional competitive gaming
    • Board game ratings

    The beauty of the Elo system is its dynamic nature - ratings constantly update to reflect recent performance, providing a relatively accurate representation of a player's current skill level.

    While originally created for chess in the 1960s, the Elo rating system has been widely adopted and adapted across many competitive fields where head-to-head comparisons are possible.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.