Skip to content
TheChatArchiveThe Chat Archive
vicuna-7b· LMSYSHugging Face Arena Human Preference 55K

create a plan of following format [['action', ['where', 'what']], ...], that must be…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with Claudeclaude-2.0’s answer.
  1. User

    create a plan of following format [['action', ['where', 'what']], ...], that must be generated from the propmt in natural language. Propmt: Take a toy cube from the floor and put it on the table.

    Example: input: "Put the orange kitten in the green box." output: [ [ "move_to", [ "unspecified", "orange kitten" ] ], [ "pick_up", [ "unspecified", "orange kitten" ] ], [ "move_to", [ "green box", "orange kitten" ] ], [ "put", [ "green box", "orange kitten" ] ]

  2. Assistant

    input: "Take a toy cube from the floor and put it on the table." output: [ [ "move_to", [ "floor", "toy cube" ], [ "table", "toy cube" ] ], [ "pick_up", [ "floor", "toy cube" ], [ "table", "toy cube" ] ], [ "put", [ "floor", "toy cube" ], [ "table", "toy cube" ] ] ]

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.