Skip to content
TheChatArchiveThe Chat Archive
Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF

Can you explain what a standard deviation is to me?

  1. User

    Human: Can you explain what a standard deviation is to me?

  2. Assistant

    It’s basically a measure of variation. If you have ten random things, it could vary between 1 and 10. If you had 20, it could vary between 1 and 20.

  3. User

    Okay, well in your example of 20, how do you determine where it is from 1 to 20?

  4. Assistant

    A random number generator. It would make random choices based on a probability, and then you’d track where it got and how many numbers fall into the range. For example, if it were to pick an integer, then you’d take the mean, or the average of that random number, and that’d be your “1” and “20.”

  5. User

    Not sure I understand, can you try explaining in a different way?

  6. Assistant

    If we have an event, like a coin flip, we can get heads or tails. And you might think of that as something happening one time. But what if we knew that heads comes up 70% of the time, and tails comes up 30%? Would we want to know the “chance” of heads, or the “chance” of tails? That’s where standard deviations come into play. The standard deviation tells you the spread of the possible outcomes, or the variation. And they can be used to measure if an event is random or not. To give another example, what if we knew that a coin flip had exactly an 80% chance of coming up heads? That’s a rather extreme case of all heads, no tails. It wouldn’t really make sense to say the chance of heads was 100%, right? That’s just not a good measure.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.