Ok as it turns out, sonnet 4 has been added to the arena but is not shown on the…
- User
Ok as it turns out, sonnet 4 has been added to the arena but is not shown on the leaderboard yet
Assistant
Ah, that makes sense! It's common for LMSYS Arena to have a delay between when a model is added to the arena for battle testing and when it appears on the public leaderboard. This usually happens because:
-
Minimum battles required: Models typically need to accumulate a certain number of battles (often hundreds or thousands) before they have enough data for a statistically reliable Elo rating.
-
Evaluation period: LMSYS might want to ensure the model is stable and performing consistently before officially adding it to the rankings.
-
Batch updates: They sometimes update the leaderboard in batches rather than in real-time.
Since Sonnet 4 is already in the arena, it should appear on the leaderboard relatively soon - probably within a few days to a couple of weeks, depending on how quickly it accumulates battles. You can help speed this up by using it in arena battles!
You might also see it appear first as an anonymized model (like "anonymous-model-xyz") before being officially revealed with its proper name.
-
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.