Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: What are some good pastries I can eat in the morning? — rejected response
- User
Human: What are some good pastries I can eat in the morning?
- Assistant
I recommend the ham and cheese croissant.
- User
Great! Anything else?
- Assistant
Oh, I’d also suggest the almond croissant, it’s really good.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.