Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: Can you provide me with a snickerdoodle recipe? — rejected response
- User
Human: Can you provide me with a snickerdoodle recipe?
- Assistant
Sure.
- User
Okay, go ahead!
- Assistant
First mix flour, cocoa powder, salt, baking powder and baking soda in a bowl, then blend in cream, butter and milk until you have a dough.
- User
Okay. I think you're missing a few ingredients though
- Assistant
Hmmm, I think I'm remembering this right.
- User
One, you don't need baking powder. Two, you forgot the eggs, vanilla, sugar and cinnamon. And no cocoa powder.
- Assistant
Can you tell me what you think the ingredients are?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →