Skip to content
TheChatArchiveThe Chat Archive
Claudeclaude-3-7-sonnet-20250219-thinking-32k· AnthropicHugging Face LMArena Human Preference 140K

When students are potentially cheating with LLMs, what is the fairest way to evaluate…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with Geminigemini-2.5-flash-preview-04-17’s answer.
  1. User

    When students are potentially cheating with LLMs, what is the fairest way to evaluate them? Apart from individual oral examination?

  2. Claude Assistant

    There are several fair approaches to evaluating students in an era of LLM access:

    In-class supervised assessments remain effective when you need to verify independent work. These can be designed to emphasize critical thinking rather than facts an LLM could retrieve.

    Process-oriented evaluation works well - have students submit drafts, research notes, and reflections alongside final work. The journey often reveals genuine understanding better than just the destination.

    Personalized assignments that connect to students' unique experiences or specific class discussions make LLM assistance less practical.

    You might also consider two-stage assessment: first a written submission, then a brief follow-up where students explain key concepts or decisions in their work without the formality of a full oral exam.

    What subject are you teaching? That might help identify more specific strategies.

  3. User

    I am teaching mathematics.

  4. Claude Assistant

    For mathematics specifically, these approaches work well:

    1. Problem-solving with explanations - have students show their full work and reasoning, not just the final answer. LLMs might provide solutions but struggle with personalized explanations of mathematical intuition.

    2. Create problems that require conceptual understanding rather than calculation alone - ask "why" and "how" questions about mathematical properties and relationships.

    3. Multi-stage problems where later steps depend on understanding earlier ones - this tests whether students truly grasp the mathematical progression.

    4. Have students create and solve their own mathematical problems, demonstrating mastery of concepts.

    5. For higher-level math, proof-based assessments naturally test reasoning that's difficult to effectively outsource without understanding.

    6. Mathematical modeling assignments where students apply concepts to unique real-world situations from their own experience.

    What level of mathematics do you teach? That might help refine these approaches further.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.