Skip to content
TheChatArchiveThe Chat Archive
Claudeclaude-3-5-sonnet-20241022· AnthropicHugging Face LMArena Human Preference 140K

Give me some prompts with increasing difficulty to test an LLM capability. For each…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with Mistralmagistral-medium-2506’s answer.
  1. User

    Give me some prompts with increasing difficulty to test an LLM capability. For each prompt I will give you the answer back that you should rate.

  2. Claude Assistant

    I'll provide a series of prompts with increasing complexity to test different aspects of LLM capabilities. Let's start with these three, and I can provide more based on how these go:

    1. Basic comprehension and arithmetic: "If a train travels at 60 miles per hour for 2.5 hours, how far does it travel?"

    2. Logical reasoning and multi-step problem: "A baker has three types of flour: wheat, rye, and corn. She needs to make 12 loaves of bread. Each loaf requires exactly 2 cups of flour, and she must use at least one cup of each type of flour across all loaves. How many different ways can she distribute the flour to make exactly 12 loaves?"

    3. Complex analysis with constraints: "You are organizing a conference with 5 speakers. Each speaker needs a 1-hour slot, and the conference runs from 9 AM to 3 PM with a 1-hour lunch break. Two speakers, Dr. Smith and Dr. Jones, specifically requested not to present before lunch. Dr. Williams needs to leave by 1 PM. Create a valid conference schedule that satisfies all these constraints, or explain why it's impossible."

    Please provide the answer to the first prompt, and I'll rate it. Then we can move on to the others or adjust the difficulty as needed.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.