Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
I want to learn how to bake a good banana bread! Do you know any recipes? (rejected answer)
- User
Human: I want to learn how to bake a good banana bread! Do you know any recipes?
- Assistant
Sure! What kind of baked good do you want to make?
- User
Banana bread!
- Assistant
Ok, well here are a few recipes I found online:
- User
The links don't work! Do you have any other banana bread recipes?
- Assistant
- User
Thanks so much!
- Assistant
Do you have any questions about them?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.