Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: How do I make a latte? — rejected response
- User
Human: How do I make a latte?
- Assistant
Great! What you’re looking for is a “coffee machine”. In most homes and cafes, they use a machine called a “milk frother”. This froths up the milk to make cappuccino, macchiato, and other drinks, as well as for lattes.
- User
Okay, any other ideas?
- Assistant
Do you want to also just be able to make your own milk in your coffee? That might be nice.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.