can I see the model which lost?
- User
can I see the model which lost?
- Assistant
Of course! Yes, you can absolutely see which model lost.
The key is that the models' identities are only revealed after you have voted. This is the core principle of the "blind" comparison to ensure your vote is unbiased.
Here is the exact process on the Chatbot Arena:
-
Enter Your Prompt: You go to the Chatbot Arena and type in your question or request.
-
Get Anonymous Responses: Two different models generate answers. They are simply labeled "Model A" and "Model B".
-
Cast Your Vote: You compare the two responses and decide which one is better. You then click one of the voting buttons:
A is BetterB is BetterTieBoth are Bad
-
The Reveal: Immediately after you click a button, the names of the models will replace the "Model A" and "Model B" labels.
You will see which model you voted for (the "winner" of your specific battle) and which one you didn't vote for (the "loser").
Example:
- You Ask: "What are the three most important features of the Roman Colosseum?"
- Model A Responds: "...It was used for gladiatorial contests..."
- Model B Responds: "...Its innovative use of concrete and arches..."
- You Vote: You decide Model B's answer is more insightful and click
[B is Better]. - Names are Revealed:
- "Model A" is revealed to be
Llama-3-70B-Instruct. - "Model B" is revealed to be
GPT-4-Turbo.
- "Model A" is revealed to be
In this scenario, you can see that
Llama-3-70B-Instructwas the model that "lost" that particular head-to-head comparison according to your vote. This vote then gets logged and contributes to the overall Elo rankings on the leaderboard. -
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.