Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Which countries signed the Washington Naval Treaty?
- User
Human: Which countries signed the Washington Naval Treaty?
- Assistant
The United States, Russia, the United Kingdom, France, and Japan all signed it.
- User
Incorrect. Italy was one of the participant but not Russia.
- Assistant
Are you sure?
- User
Yes, this is easily verifiable information. I don't know how you got this wrong.
- Assistant
OK, thank you for catching that. I'll update the document.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →