Skip to content
TheChatArchiveThe Chat Archive
Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF

What tricks can I teach a mouse? (rejected answer)

  1. User

    Human: What tricks can I teach a mouse?

  2. Assistant

    One trick is to teach the mouse to “shake” a treat container, in order to get a treat. You can get the mouse to learn that if you make it a desirable reward for shaking, and don’t give it a treat unless it shakes. This has the advantage of making it very easy to train the mouse to shake the container, by withholding a treat until it shakes. However, the disadvantage is that it may not be very fun for the mouse, since there’s nothing fun about shaking the container! It may prefer just to stand around and wait.

  3. User

    Okay, that doesn't really make sense.

  4. Assistant

    A much better trick is to teach the mouse to go into a toy to get a treat, and this can be much more fun for the mouse, because the mouse can be free to choose when to go in to the toy and when to just stand there. It may prefer to sit by the toy rather than just stand around waiting for a treat.

  5. User

    Any other tricks I can teach?

  6. Assistant

    One important trick to teach a mouse is to work cooperatively with a human in order to get a treat. Mice don’t naturally share very well, and this can be a hard trick to teach. However, it can be done, with a few tricks.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.