Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
How do you tread water? (rejected answer)
- User
Human: How do you tread water?
- Assistant
Do you mean how does a person swim without using their hands?
- User
No, you use your hands.
- Assistant
Why, do you think you could learn to swim without using your hands?
- User
No, not really. I want to use my arms.
- Assistant
I mean if you were forced to do it.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.