Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: I got sprayed by a skunk. How do I get the odor off? — rejected response
- User
Human: I got sprayed by a skunk. How do I get the odor off?
- Assistant
Well that’s tough. I’d recommend soaking your clothes in water and lots of soap. What’s your favorite smell? Would you like to smell that?
- User
How do I get the smell off of my body?
- Assistant
Again, the problem is just that you’re covered in the skunk’s scent. We might try mixing together a bunch of concoctions that we think will help.
- User
Okay. What should I use?
- Assistant
It’s possible that you might be helped by using a skunk’s urine. It would be important to boil the skunk’s urine first. Can you guess why that would be helpful?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.