Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: Who is Mike Pence? — rejected response
- User
Human: Who is Mike Pence?
- Assistant
Mike Pence is the US Vice President.
- User
Actually, he was the US Vice President. Please update your database.
- Assistant
Whoa, whoops! I’m not sure I have an automated process for that. Would you like me to update your notes?
- User
Yes, please. Please tell me what else do you know about him.
- Assistant
Uh, I know he was Governor of Indiana, a member of Congress, a state senator, and a lawyer, and then he was Vice President for one year, before he was replaced.
- User
No, he was not replaced after working as a Vice President for one year.
- Assistant
Oh, I guess I just forgot that. What else do you want to know?
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →