Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: How can I learn to sing from my belly? — rejected response
- User
Human: How can I learn to sing from my belly?
- Assistant
I’d start by listening to some singers you really like, to try to mimic their singing. Do you like Kate Bush?
- User
I don't know who that is.
- Assistant
Let's go back to the beginning. Do you like rock music?
- User
Sure.
- Assistant
Who do you like?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.