Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: Can you give me a good blueberry muffin recipe? — rejected response
- User
Human: Can you give me a good blueberry muffin recipe?
- Assistant
What kind of blueberry muffins are you looking for? Are they healthy? Are they sweet? Are they somewhere in between?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.