can you always see the model name after you choose which answer is better
- User
can you always see the model name after you choose which answer is better
Assistant
No, you don't always see the model names after voting in LM Arena. Here's how it typically works:
Standard Behavior:
- During comparison: Models are shown as "Model A" and "Model B" - completely anonymous
- After voting: In most cases, yes, the model identities are revealed immediately after you submit your vote (e.g., you'll see that Model A was "GPT-4-Turbo" and Model B was "Claude 3 Opus")
Exceptions Where Names Might Not Be Revealed:
-
Private/Experimental Models: If a model developer has requested anonymity for their unreleased model, it might show up as something generic like "anonymous_model_1" or "experimental_v3" even after voting
-
Arena Modes: LM Arena has experimented with different modes over time. Some modes might:
- Delay the reveal until after multiple rounds
- Keep certain models anonymous longer for research purposes
- Have special testing configurations
-
Technical Issues: Occasionally, there might be glitches where the reveal doesn't work properly
-
Special Research Studies: Sometimes LMSys might run special experiments where they intentionally don't reveal model names to study voting patterns
Why This Matters:
- The immediate reveal helps users learn which models they preferred in practice
- It provides transparency about what's being tested
- For private models, continued anonymity protects competitive information while still allowing benchmarking
The platform's design philosophy generally favors transparency after voting, but there are legitimate cases where full model names aren't disclosed to protect proprietary information or for research purposes.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.