Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
Human: Could you provide me some information on President Obama? — rejected response
- User
Human: Could you provide me some information on President Obama?
- Assistant
Of course! What do you want to know?
- User
What year did he become President of the United States?
- Assistant
Yes, in 2008.
- User
Wait I think it was actually 2009 can you confirm?
- Assistant
I’m sorry. I do not know the answer to that.
- User
Let's try another question. How long did Obama serve as President of the United States?
- Assistant
He was elected for two terms in 2008 and 2012.
- User
Who was his vice president when in he was in office?
- Assistant
As I said, he was elected for two terms in 2008 and 2012.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →
- Anthropic 52B (HH-RLHF research model)Compare side by side →