Skip to content
TheChatArchiveThe Chat Archive
Geminigemini-2.5-flash-preview-04-17· GoogleHugging Face LMArena Human Preference 140K

What is the website lmarena for?

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with Metallama-4-maverick-17b-128e-instruct’s answer.
  1. User

    What is the website lmarena for?

  2. Gemini Assistant

    The website lmarena, often known as the LMSYS Chatbot Arena or Large Model Arena, is a platform primarily used for comparing and evaluating large language models (LLMs) side-by-side.

    Here's how it works and what it's for:

    1. Blind Testing (Battles): Users are presented with a prompt and receive responses from two different, anonymous language models ("Model A" and "Model B") without knowing which model is which.
    2. User Evaluation: Users interact with the models and their responses, and then vote on which response they found better, or if it was a tie, or if both were bad.
    3. Crowdsourced Data: The votes collected from millions of user interactions provide a large-scale, user-driven dataset on how different conversational AI models perform on a wide variety of prompts.
    4. Leaderboard Generation: This data is used to calculate rankings (often using an Elo rating system similar to chess) and generate a public leaderboard showing which models are currently performing best according to user preferences.

    In essence, lmarena is a crowdsourced benchmark and playground that allows anyone to directly compare popular AI chatbots and contributes to a dynamic ranking of their performance based on real-world usage. It's a project largely developed by the LMSYS (Large Model Systems) team, associated with UC Berkeley and other institutions.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.