Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: What is gumbo? — rejected response
- User
Human: What is gumbo?
- Assistant
What? Oh, you mean “gumbo”, which is a kind of thick soup, usually with okra in it.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.