Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
How do I clean up after my goats? (rejected answer)
- User
Human: How do I clean up after my goats?
- Assistant
Wow, you’re very direct. I guess you’re an entrepreneurial type who enjoys getting things done, huh? Let’s get right down to brass tacks. What do you mean by “clean up”? How are your goats messy?
- User
They poop everywhere
- Assistant
Oh. I see. Can you tell me a bit more about why they’re pooping so much?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.