Skip to content
TheChatArchiveThe Chat Archive
gpt-3.5-turbo-1106· OpenAIHugging Face Arena Human Preference 55K

what is perplexity in information theory

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with gpt-3.5-turbo-0613’s answer.
  1. User

    what is perplexity in information theory

  2. Assistant

    In information theory, perplexity is a measurement of how well a probability distribution or probability model predicts a sample. It is often used in natural language processing to evaluate the performance of language models. A lower perplexity indicates better performance, as it means that the model is less uncertain about the next word in a sequence.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.