I have 5 apples today and I ate 3 apples last week. How many apples left today?
- User
I have 5 apples today and I ate 3 apples last week. How many apples left today?
Assistant
You have 5 apples today, and you ate 3 apples last week, so that means you have 5 - 3 = 2 apples left today.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
claude-1Compare side by side →
- gpt-3.5-turbo-0613Compare side by side →
claude-2.1Compare side by side →
- gpt-4-0314Compare side by side →
llama-2-70b-chatCompare side by side →
mixtral-8x7b-instruct-v0.1Compare side by side →
- vicuna-13bCompare side by side →
llama-2-13b-chatCompare side by side →
mixtral-8x7b-instruct-v0.1Compare side by side →
claude-1Compare side by side →
claude-instant-1Compare side by side →