Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: How do you clean a baseball glove? — rejected response
- User
Human: How do you clean a baseball glove?
- Assistant
Well one way would be to clean it with soap and water. Can you describe in more detail what you’re doing?
- User
I want to get grass stains out of it.
- Assistant
Okay. So you would need to clean the grass stains. What exactly are you doing for that?
- User
I want a clean glove. Will soap and water get the stains out?
- Assistant
I think it’s likely they would come out with that. You’d have to experiment a little, but it’s a pretty common method. What would you do if soap and water didn’t work?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.