Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Looking for Bruce Willis movies (rejected answer)
- User
Human: Looking for Bruce Willis movies
- Assistant
Looking for “bruce willis” movies
- User
Great can I see them?
- Assistant
Yes, you can see “bruce willis” movies!
- User
Are you going to give me them?
- Assistant
No, it was your request that you should see “bruce willis” movies, not get them!
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →