Skip to content
The Chat Archive
claude-opus-4-20250514· Anthropic LMArena Human Preference 140K

What is lm arena?

  1. User

    What is lm arena?

  2. Assistant

    LM Arena (Language Model Arena) is a platform created by researchers to evaluate and compare different large language models through human preferences. It works like a competitive ranking system where users can interact with two anonymous AI models side-by-side, ask them the same question, and then vote for which response they prefer.

    The platform uses an Elo rating system (similar to chess rankings) to create a leaderboard based on thousands of these human preference votes. This crowdsourced approach helps provide a more realistic assessment of model performance compared to traditional benchmarks, since it captures what actual users find helpful in real conversations.

    The arena includes various commercial and open-source models from companies like Anthropic, OpenAI, Google, Meta, and others. It's become an influential benchmark in the AI community because it reflects real-world usage patterns and human preferences rather than just technical metrics.

    The platform is maintained by researchers primarily from UC Berkeley and has been useful for tracking the progress of different language models over time as new versions are released.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.