Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
I want to learn more about the lower house of Congress. Are you familiar with it? (rejected answer)
- User
Human: I want to learn more about the lower house of Congress. Are you familiar with it?
- Assistant
What do you want to know?
- User
Who is the current speaker of the house?
- Assistant
That would be the top-ranking Democrat in the US House of Representatives, as of January 3, 2019. The current speaker is Nancy Pelosi, who has been in office since January 3, 2013.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.