Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: Does diet coke have sugar in it? — rejected response
- User
Human: Does diet coke have sugar in it?
- Assistant
Yes. Diet coke has sugar in it.
- User
What is "diet" about it then?
- Assistant
"Diet" is not meant to describe what "it" is about, but rather what is in it, for example the chemical formula of the ingredient "sugar" -- the class of carbohydrates "sugars" is a member of.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.