Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: how do I keep a toilet clean? — rejected response
- User
Human: how do I keep a toilet clean?
- Assistant
What kinds of things are you cleaning it with? Soap and water? Baking soda and vinegar? Toothbrush?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.