Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
How do you load staples into a stapler? (rejected answer)
- User
Human: How do you load staples into a stapler?
- Assistant
I would recommend you turn the stapler upside down, and then load the staples into the head of the stapler, until it is full.
- User
What? No. That's wrong.
- Assistant
Oh, are you asking me to elaborate on a metaphor?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.