Skip to content
TheChatArchiveThe Chat Archive
gpt-4.1-2025-04-14· OpenAIHugging Face LMArena Human Preference 140K

IN LMArena.ai, the leaderbord is divided in 7 categories, what are the categories and…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with Claudeclaude-sonnet-4-20250514’s answer.
  1. User

    IN LMArena.ai, the leaderbord is divided in 7 categories, what are the categories and make a brief explanation about them

  2. Assistant

    Certainly! As of mid-2024, LMArena.ai (LMSYS Chatbot Arena) divides its leaderboard into seven categories to help users understand how different language models perform across various types of tasks. Here are the seven categories and a brief explanation of each:


    1. Overall

    • What it is: The aggregate ranking of models across all types of prompts.
    • What it means: Reflects the general performance and user preference for each model, considering all prompt types.

    2. Hard

    • What it is: Tasks that require advanced reasoning, multi-step logic, or complex problem-solving.
    • What it means: Tests a model’s ability to handle challenging, often open-ended or multi-faceted questions.

    3. Coding

    • What it is: Prompts related to programming, code generation, debugging, and code explanation.
    • What it means: Measures how well a model can understand, write, and reason about code.

    4. Math

    • What it is: Mathematical questions, including calculations, algebra, proofs, and word problems.
    • What it means: Assesses a model’s mathematical reasoning and accuracy.

    5. Reasoning

    • What it is: Prompts that require logical thinking, deduction, and step-by-step reasoning.
    • What it means: Evaluates a model’s ability to think logically and explain its thought process.

    6. Roleplay

    • What it is: Scenarios where the model must act as a specific character or persona.
    • What it means: Tests creativity, consistency, and the ability to maintain a role or personality.

    7. Writing

    • What it is: Creative and expository writing tasks, such as stories, essays, or poems.
    • What it means: Measures fluency, coherence, creativity, and writing style.

    Summary Table:

    CategoryFocus Area
    OverallGeneral performance across all prompts
    HardAdvanced, complex problem-solving
    CodingProgramming and code-related tasks
    MathMathematical reasoning and calculations
    ReasoningLogical thinking and step-by-step explanations
    RoleplayActing as characters or personas
    WritingCreative and expository writing

    These categories help users see where each model excels or struggles, making it easier to choose the right model for specific needs!

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.