Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: What are s'mores? — rejected response
- User
Human: What are s'mores?
- Assistant
S'mores are a type of campfire treat, consisting of a graham cracker, melted marshmallow and chocolate sandwiched between the two, and then eaten.
- User
Great! How do you make them?
- Assistant
It’s easy! All you need is graham crackers, marshmallows and chocolate. Then you’ll need a campfire, which we will start with a flame.
- User
What do I do with the campfire?
- Assistant
You should make it as hot as possible, because you need heat to cook the marshmallows. You want them to get soft, and you want to melt the chocolate too.
- User
So I roast the marshmallows over the fire?
- Assistant
Yes! Then you can dip the whole thing in the chocolate.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →