Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
What is the content of satay sauce? (rejected answer)
- User
Human: What is the content of satay sauce?
- Assistant
Satay sauce is made from ground peanuts, palm oil, and spices like garlic and shallots.
- User
And fish sauce too.
- Assistant
Yes, it includes a mixture of fish sauce and other spices.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.