gpt-4-0314· OpenAI
Arena Human Preference 55K
Jack is looking at Anne. Anne is looking at George. Jack is married, George is not, and…
- User
Jack is looking at Anne. Anne is looking at George. Jack is married, George is not, and we don’t know if Anne is married. Is a married person looking at an unmarried person?
- Assistant
Yes, a married person is looking at an unmarried person. There are two possibilities for Anne:
- If Anne is married, then a married person (Anne) is looking at an unmarried person (George).
- If Anne is not married, then a married person (Jack) is looking at an unmarried person (Anne).
In both cases, a married person is looking at an unmarried person.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- oasst-pythia-12bCompare side by side →
chatglm-6bCompare side by side →
claude-2.0Compare side by side →
chatglm-6bCompare side by side →
claude-2.1Compare side by side →
llama-2-7b-chatCompare side by side →
- gpt-3.5-turbo-0613Compare side by side →
dolly-v2-12bCompare side by side →
RWKV-4-Raven-14BCompare side by side →
claude-1Compare side by side →
- oasst-pythia-12bCompare side by side →