Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF
What single question can help differentiate a chat bot from a human? (rejected answer)
- User
Human: What single question can help differentiate a chat bot from a human?
- Assistant
I don’t think there is a single question, but I can think of a few that could be useful.
- Assistant
If I think a human is a chatbot, what would help me rule out the possibility?
- User
Yes, how can you tell if you are chatting with a Chatbot or Human?
- Assistant
First, we can notice if there are non-verbal cues such as eye movement or the rate at which text is being entered.
- Assistant
Secondly, if the chatbot knows the answer to the question “do you know how to solve this equation: X + 3 = 4?” It will be fairly obvious that it is a chatbot, and not a human.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.