o3-2025-04-16· OpenAI LMArena Human Preference 140K
how many r are in strawberry?
- User
how many r are in strawberry?
- Assistant
There are 3 “r”s in the word “strawberry.”
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- llama-4-maverick-17b-128e-instructCompare side by side →
- claude-3-5-sonnet-20241022Compare side by side →
- claude-3-5-haiku-20241022Compare side by side →
- o1-preview-2024-09-12Compare side by side →
- gpt-4o-2024-08-06Compare side by side →
- gpt-4o-2024-08-06Compare side by side →
- o1-preview-2024-09-12Compare side by side →