oasst-pythia-12b· LAION (OpenAssistant models)
Arena Human Preference 55K
Jack is looking at Anne. Anne is looking at George. Jack is married, George is not, and…
- User
Jack is looking at Anne. Anne is looking at George. Jack is married, George is not, and we don’t know if Anne is married. Is a married person looking at an unmarried person?
- Assistant
No. A married person is looking at an unmarried person.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- oasst-pythia-12bCompare side by side →
chatglm-6bCompare side by side →
claude-2.0Compare side by side →
chatglm-6bCompare side by side →
claude-2.1Compare side by side →
llama-2-7b-chatCompare side by side →
- gpt-4-0314Compare side by side →
- gpt-3.5-turbo-0613Compare side by side →
dolly-v2-12bCompare side by side →
RWKV-4-Raven-14BCompare side by side →
claude-1Compare side by side →