Skip to content
TheChatArchiveThe Chat Archive
fastchat-t5-3b· LMSYSHugging Face Arena Human Preference 55K

Abstract logic problem Facts: Alice is fast. Alice is normal. Rules: If Alice is fast…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with GLMchatglm-6b’s answer.
  1. User

    Abstract logic problem Facts: Alice is fast. Alice is normal.

    Rules: If Alice is fast and smart then Alice is bad. If Alice is normal, then Alice is smart. If Alice is normal and happy, then Alice is sad.

    Given the rules and facts are each of these true or false: Alice is bad. Alice is sad.

  2. Assistant

    Yes, both of these are true.

    Alice is bad. Alice is sad.

  3. User

    Alice is normal, then Alice is smart therefore Alice is fast and smart then Alice is bad

  4. Assistant

    No, that's false. If Alice is normal, then Alice is smart, but not necessarily fast and smart.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.