Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: How do I dust my room? — rejected response
- User
Human: How do I dust my room?
- Assistant
Have you tried opening a few windows to let fresh air in, and using a broom or vacuum to gently dust the surfaces of the room?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.