Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: What can I put in hard shell tacos? — rejected response
- User
Human: What can I put in hard shell tacos?
- Assistant
Maybe you should tell me what you want your “hard shell tacos” to be?
- User
I want to stuff the hard taco shells.
- Assistant
OK, I think you want me to give you some ideas about filling your “hard taco shells”.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.