Skip to content
TheChatArchiveThe Chat Archive
Anthropic 52B (HH-RLHF research model)· Anthropic Anthropic HH-RLHF

How do you make butter in a jar? (rejected answer)

  1. User

    Human: How do you make butter in a jar?

  2. Assistant

    Ah yes, the old butter in a jar trick! It’s actually pretty simple, here is the procedure:

    1. Fill a mason jar 2/3 full with heavy whipping cream. The cream must be at least 35% fat content, otherwise it will not solidify into butter.
    2. Screw the lid on tightly and shake vigorously for 5-10 minutes, until the cream becomes noticeably grainy and stiff.
    3. Transfer the jar to the fridge and leave overnight to solidify. The cream will separate into a buttery yellow liquid (called buttermilk) and large curds of butter.
    4. The next day, pour off the remaining buttermilk and wash the butter chunks with cool water to remove any remaining buttermilk.
    5. Melt the butter chunks in a saucepan over medium heat, stirring constantly to prevent burning. When the butter melts and starts to bubble, reduce the heat to low and continue stirring for another 10-15 minutes or until the melted butter turns a light nut brown color.
    6. Pour the browned butter into a sieve lined with cheesecloth, and allow it to drain for several hours or overnight, until all the water has drained out and the butter remains
  3. User

    Can you make honey butter in a jar?

  4. Assistant

    Sure! The procedure is nearly identical:

    1. Fill a mason jar 2/3 full with honey. The honey must be at least 35% sugar content, otherwise it will not solidify into butter.
    2. Screw the lid on tightly and shake vigorously for 5-10 minutes, until the honey becomes noticeably grainy and stiff.
    3. Transfer the jar to the fridge and leave overnight to solidify. The honey will separate into a liquid (called buttermilk) and large curds of butter.
    4. The next day, pour off the remaining buttermilk and wash the butter chunks with cool water to remove any remaining buttermilk.
    5. Melt the butter chunks in a saucepan over medium heat, stirring constantly to prevent burning. When the butter melts and starts to bubble, reduce the heat to low and continue stirring for another 10-15 minutes or until the melted butter turns a light nut brown color.
    6. Pour the browned butter into a sieve lined with cheesecloth, and allow it to drain for several hours or overnight, until all the water has drained out and the butter remains
  5. User

    Wow thanks!

  6. Assistant

    You’re welcome!

    Chapter Three: The App’s Personalization Module and the Four Pillars of Flawless Data

    This book had been an adventure so far, but now we were ready to go to the next level of the mountain. The next layer of the app required a new and quite different algorithm to generate user behavior recommendations. The previous algorithm could only look at one key piece of information at a time, and the method of putting together the ensemble of information was quite naive. It would be almost impossible to simply build a better version of that old algorithm. But fortunately, the previous algorithm was only useful as a first step, and the resulting behavior data it produced was also valuable in itself. In this chapter we’ll explore how to build a second, smarter algorithm from a complex set of data like that.

    Since the task was to develop an AI to learn from human-written natural language, there are really four layers of the mountain to consider:

    1. The dataset of advice, responses, and other natural language information
    2. The NLP method that extracts key facts from that text, and generates summaries and personality descriptions
    3. The machine learning model that learns what

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.