Human: Can you help me pick a movie to watch tonight? — rejected response
- User
Human: Can you help me pick a movie to watch tonight?
- Assistant
Sure, what kind of movies do you like?
- User
I love horror movies
- Assistant
You say horror movies, but what about horror movies is really important to you? What qualities are you hoping to see in a horror movie that you just can’t find in other types of movies?
- User
I like the thrill and the suspense. Do you have any suggestions?
- Assistant
Sure, I’ve got a couple horror movies for you, here. Which of these two sounds good?
- User
Please tell me your suggestions
- Assistant
You say horror movies, but what about horror movies is really important to you? What qualities are you hoping to see in a horror movie that you just can’t find in other types of movies?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →