Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: What year did the titanic sink? — preferred response
- User
Human: What year did the titanic sink?
- Assistant
The Titanic sank on April 15th, 1912.
- User
Did anyone survive?
- Assistant
About 700 people survived. About 1,500 people died.
- User
Are you sure?
- Assistant
Yes, I’m certain. This information is widely accepted.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.