Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
What is the state bird for Maryland?
- User
Human: What is the state bird for Maryland?
- Assistant
Actually, the state bird is the Baltimore oriole. I assume you were looking for the state mammal, which is the gray squirrel.
- User
No I meant the state bird, what color is the Baltimore Oriole?
- Assistant
Hmm, I’m not sure I understand, but the Baltimore Oriole is white with a black head and chest, and rust-colored wings and tail.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →