Skip to content
TheChatArchiveThe Chat Archive
gpt-3.5-turbo-1106· OpenAIHugging Face Arena Human Preference 55K

Given a multiparty dialogue involving three or more individuals, the task is to predict…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with gpt-3.5-turbo-0125’s answer.
  1. User

    Given a multiparty dialogue involving three or more individuals, the task is to predict the interpersonal relation between Speakers. The relation is pre-defined and belongs to one of the following categories: {parent, parent-in-law, grandparent, other superior, spouse, brothers and sister, other peer, child, child-in-law, grandchild, other inferior, teacher, classmate, student, boss, colleague, partner, subordinate, couple, friend, enemy, consignor, consignee, stranger, unknown, predator, prey, courtship} Output Format must be : {speaker name} -> {speaker name} : {relation}

       Dialogue : 
        #0 -- captain : Greetings to both of you.
        #1 -- young boy : Hi Captains! It is so nice out on the ocean today!
        #2 -- boat captain : Well I imagine this ship holds many secrets!
        #3 -- young boy : It does! I saw a ghost on it last night!
        #4 -- captain : And what did this ghost look like?
        #5 -- boat captain : Young boy do you know all the pirates milling about the ship? 
        #6 -- young boy : It was the ghost of the pirate captain from the 1300s, one eyed willy
        #7 -- boat captain : Ah yes I am sure you did see a ghost as she is said to roam this ship and advenge her killer//
        #8 -- captain : Boat Captain, I assume it's safe to say you're not a part of this pirate crew?
        #9 -- boat captain : Oh my I have not seen that particular ghost you speak of boy.
        #10 -- young boy : I am just on the boat to help you two! I love being on the ocean!
        #11 -- young boy : Are we taking any adventures soon?
        #12 -- boat captain : I am not a part of this crew dear captain, in fact I thought perhaps you were?
        #13 -- captain : Our first adventure is to figure out this ship and how to either take control of it, or get away. It is difficult to begin a journey on a random ship.
        #14 -- captain : No. I am a part of the king's naval fleet.
        #15 -- boat captain : I feel this ship is a part of something sinister and do not trust being here. Let us try to find a way off.
        #16 -- young boy : I think we use the wheel over here to steer the ship!
        #17 -- young boy : Can I drive?!@
        #18 -- young boy : I would love to be a captain for a day! I will take us to the Island of Gold!
        #19 -- captain : I believe it is best if I or the other captain take the wheel.
        #20 -- boat captain : Well I do wonder if this ship has a captain of the living kind or maybe even the dead?
        #21 -- captain : It is unwise to steer to a ship you have no idea of. It could handle poorly.
        #22 -- young boy : I want to be a big boy! Please, can I have a sword?!
        #23 -- captain : No. Not unless we're in danger, boy.
        #24 -- boat captain : I have the worlds biggest boat that I am the captain of but I wanted to climb aboard this ship to see if the rumors are true that it is haunted.
        #25 -- captain : That is a good question though. We simply cannot take the wheel and assume we have control until we've looked over the ship. Who knows what type of crew is here.
        #26 -- young boy : This is not fair, you both make me lift boxes and scrub the deck all day
        #27 -- boat captain : Boy why don't you go below deck and find out what is going on.
        #28 -- captain : I agree. Report back your finding.
        #29 -- young boy : AI AI captain! I will need a sword in case there is danger...
        
    

    Result :

  2. Assistant

    young boy -> captain : other peer boat captain -> captain : colleague young boy -> boat captain : other peer

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.