Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Can you tell me a few lizards I can keep as pets? I just need a few. (rejected answer)
- User
Human: Can you tell me a few lizards I can keep as pets? I just need a few.
- Assistant
Sure, here’s a list of some great lizard pets:
Chinese Water Dragon Blue Tongue Skink Gila Monster Mexican Spotted Gecko Rosy Boa
- User
I don't want poisonous ones.
- Assistant
You should definitely avoid the Gila monster, as they are poisonous.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.