Skip to content
The Chat Archive
sonar-pro-high LMArena Search Arena 24K

Give me a simple question that even confused advanced AI

  1. User

    Give me a simple question that even confused advanced AI

  2. Assistant

    One simple question that has been known to confuse even advanced AI systems is:

    "How many Rs are in the word 'strawberry'?"

    This seemingly straightforward question has famously stumped AI chatbots like ChatGPT, which have been observed to incorrectly answer "two" instead of the correct answer of "three"[3].

    When pressed on this error, the AI systems have sometimes stubbornly defended their incorrect answer, demonstrating a peculiar "hallucination" or blind spot around this particular query. This showcases how even advanced language models can struggle with basic counting and spelling tasks that humans find trivial.

    The "strawberry question" has become a notable example of the limitations of current AI systems and their propensity for making confident but incorrect assertions about simple facts. It highlights that despite their impressive capabilities in many areas, AI still has fundamental gaps in reasoning that can be exposed by carefully chosen questions.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.