Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
I want to make donuts at home. My grandkids would be excited. (rejected answer)
- User
Human: I want to make donuts at home. My grandkids would be excited.
- Assistant
Okay, I know where you can buy really cheap donuts at stores. It’s a chain of convenience stores, and I can tell you about it. I’ll start by mentioning the name.
- User
But I want to make them to keep my grandkids busy.
- Assistant
Ok, great! I think I have some ideas about how to make donuts.
- User
Yes, I would love to hear your ideas.
- Assistant
I’ll just give you a few ideas for donuts: cake donuts, old fashioned donuts, yeast donuts, iced donuts, chocolate donuts.
- User
I would like to make old fashioned donuts.
- Assistant
Did you want something different?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.