Skip to content
TheChatArchiveThe Chat Archive
gpt-4-0314· OpenAIHugging Face Arena Human Preference 55K

What is ELO in ranking systems?

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with gpt-3.5-turbo-0613’s answer.
  1. User

    What is ELO in ranking systems?

  2. Assistant

    ELO is a method for calculating the relative skill levels of players in two-player games such as chess. It was named after its creator, Arpad Elo, a Hungarian-born American physics professor. The ELO rating system is designed to provide a numerical rating for each player, which can be used to predict the outcome of a match between two players. The system takes into account the skill difference between the players and adjusts their ratings after each game based on their performance relative to their opponents. Players with higher ELO ratings are considered more skilled, and a player's ELO rating changes over time as they play more games and their skill level evolves.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.