Skip to content
TheChatArchiveThe Chat Archive
gpt-4o-search-preview-high· OpenAIHugging Face LMArena Search Arena 24K

السلام عليكم طبيب عمار يا أهلًا ما هي مشكلتك، من ماذا تعاني؟ إنني أعاني في الشهر الأخير…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with gpt-4o-search-preview-high-loc’s answer.
  1. User

    السلام عليكم طبيب عمار يا أهلًا ما هي مشكلتك، من ماذا تعاني؟ إنني أعاني في الشهر الأخير من ألم في البلعوم وحرارة مرتفعة أعتقد أن هناك التهاب في الحنجرة، سوف أصف إليك علاجين، العلاج الأول مسكن للألم، العلاج الثاني مضاد لالتهاب الحنجرة شكرا جزيلا أهلا " {'chief_complaint': 'Pain in the pharynx and high fever', 'allergy': '', 'history_of_present_illness': 'Patient is suffering from pain in the pharynx and high fever during the last month.', 'past_medical_history': '', 'social_history': '', 'family_history': '', 'physical_examination': '', 'diagnosis': 'Laryngitis', 'prescription_medications': 'Ibuprofen 600 mg; Anti-laryngitis treatment', 'current_medications': '', 'laboratory_tests': '', 'plan_of_care': 'Follow up care, treatment plan for laryngitis'}"

    مرحبا دكتور عمار يا أهلين مبين، مبين كيالي صح؟ ايه صح يا أهلين مبين، قوللي مبين شو مشكلتك؟ والله يا دكتور أنا إلي حدود شهر بعاني من ركبتي اليمين فيها ألم لما بصعد على الدرج أو بنزل أو لما بمشي مسافة طويلة. بس هيك يعني ألم من الداخل من جهة مفصل الركبة تعرضت شي لإصابة؟ بتلعب بالجيم أو بتلعب كرة قدم ولا إيش؟ هو بس كنت بحمل أحمال تقيلة بالفترة اللي فاتت وممكن هذا أثّر. حسيت بآلام بعدها وممكن فيه إصابة قديمة. هذا الألم بيخليك تنام ولا ما بيخليك تنام لهاي الدرجة يعني؟ هلأ الفترة الحالية بحس بألم شديد يعني بس خف شوي مع المسكنات بس الألم لا زال موجود معايا تمام أنا هلأ رح بكتبلك مسكن ألم medicine من الصيدلية تصرفه مسكن ألم مشان تحسن إذا بدك ترتاح أو تنام، كمان رح بكتبلك أشعة صوتية ultrasound للركبة اليمين رح تحطها بالسيستم وتسجلها وتروح قسم الأشعة مشان تعطيني تفاصيل أكتر عن الإصابة. حسب صورة الأشعة اللي راح تعملها ممكن نقرر إذا بتحتاج عملية ولا لا، بس هذا الشي بيتقرر الأسبوع الجاي. حاليا رح بعطيك مسكن الألم وتعمل الأشعة وترجعلي مشان نشوف إذا بتحتاج عملية ولا ما يحتاج. أوكيه تمام " {'chief_complaint': 'Pain in the right knee when going up or down stairs or walking for a long distance', 'allergy': 'No known allergies', 'history_of_present_illness': 'Patient is experiencing severe pain in the right knee, which slightly decreases with painkillers. The pain is present even after taking painkillers.', 'past_medical_history': '', 'social_history': '', 'family_history': '', 'physical_examination': '', 'diagnosis': 'Right knee pain', 'prescription_medications': 'Pain relief medicine', 'current_medications': '', 'laboratory_tests': 'Ultrasound for the right knee', 'plan_of_care': 'Patient to take prescribed pain relief medicine, register for ultrasound at radiology department, and follow up with doctor next week to assess if surgery is needed.'}"

    مرحبا دكتور عمار يا أهلين مبين؟ نعم مبين قوللي مبين شو المشكلة؟ عندي مشكلة في أسناني، الطرف الأيمن من فوق في فكي العلوي، أضراسي اللي من الخلف بتوجعني كتير، وبحس احمرار كمان في اللثة. خليني أفحصك، افتح تمك أوك تمام عم بيوجعك هذا السن؟ ايه عم بيوجعني وهذا الي جمبه؟ كمان تمام مبين، فيه عندك التهاب بالسن رقم 2 والسن رقم 3 بيحتاج خلع extraction procedure. بخصوص الالتهاب ممكن ان احنا نعالجه بأدوية رح بكتبلك أول شي مسكن ألم بروفين 600 وأوجمنتين لمعالجة الالتهاب. بخصوص الـ extraction رح نرفع موافقة لشركة التأمين ومجرد ما توصل الموافقة رح نعملك خلع لهذا الضرس بتاكل شي سكريات كتير ولا؟ ايه، باكل شوكولاتة وحلويات بدك تخفف منهم مبين، مشان يخف الألم ويخف الالتهاب. هذا أهم شي، تفرش سنانك تتمخمض بماية سخنة وملح. بدي منك، رح بكتبلك كمان Panorama Xray مشان نشوف الأضراس قبل الخلع وبعد الخلع ونشوف كمان حالة العصب. نخفف حلويات واتمخمض بماية سخنة وملح وراجعني بعد 3 أيام. أوك تمام يلا يعطيك العافية " {'chief_complaint': 'Pain in the right side of the upper jaw, back molars, and redness in the gums', 'allergy': 'No known allergies', 'history_of_present_illness': 'Patient is a 10-year-old boy with a problem with his teeth, the right side of the upper jaw, back molars hurt a lot, and he feels redness in the gums. The patient has a history of consuming a lot of sugary foods.', 'past_medical_history': '', 'social_history': '', 'family_history': '', 'physical_examination': '', 'diagnosis': 'Inflammation in tooth number 2 and tooth number 3', 'prescription_medications': 'Ibuprofen 600; Augmentin', 'current_medications': '', 'laboratory_tests': 'Panoramic X-ray', 'plan_of_care': 'Reduce sweets, brush teeth, rinse with warm salt water, get a Panoramic X-ray, come back after 3 days'}"

    Given the arabic transcription and their corresponding soap notes with following sections. I am using qwen 2.5 7b instruct model to do the same task using below prompt. However I am not getting the exact output or desirable output. Please rewrite the prompt and make the changes if required to generate above soap note for similar transcriptions. Make the prompt generic for longer, shorter transcriptions

    prompt_style2='''Below is an instruction that describes few tasks, paired with an input that provides further context.\nProvide an accurate response at end that appropriately completes the specified tasks. Only use the information provided in the input. Do not infer or assume additional details.\n\n### Instructions:\n\nTask 1:\n- Check if the conversation is entirely in English, then do not translate and skip directly to Task 3.\n- Check if the conversation contains any Arabic text (fully or partially), perform Task 2.\n\nTask 2:\nAct as a professional English translator specialized in translating doctor patient conversation. Translate the provided conversation into clear and accurate English language while maintaining the integrity of all the medical terminologies, drugs, medications, surgeries, etc and other healthcare-related terms. Ensure no alterations or misinterpretations, particularly for medications and treatments. Do not mistranslate the medication or drugs name. For example, medical terms like “إيبوبروفين 600” should be translated as "Ibuprofen 600" and not translate as "Proven 600". Do not miss or overlook any important medical discussion between doctor and patient. Do not include the translated conversation in the final response. After translation, proceed directly to Task 3.\n\nTask 3:\nUsing the details from the translated (if Arabic) or English conversation, extract the relevant information and generate a SOAP note in English with the following sections and structure the information in a JSON format with only keys as lowercased. Check if the conversation does not contain any relevant information for a particular section, always leave that section blank or write “Not mentioned.”. Do not make assumptions.\n\nChief Complaint: Include the patient's primary reason for the visit, such as signs, symptoms, severity, etc. Do not include patient age or gender under chief complaints. Never leave this section blank.\nAllergy: Include information about any known allergies. If no allergies are discussed, return “No known allergies”. In the case of multiple allergies, always separate each allergy by a semicolon (';').\nHistory of Present Illness: Start with the patient's reason for the visit. Include details of the chief complaint only if discussed in the conversation, covering onset, duration, timing, quality, severity, and any other relevant history related to the complaint. Document any additional complaints, signs, and symptoms mentioned. If the patient denies any symptoms, explicitly include them. If screenings, lab results, or markers are discussed, incorporate them as well. Additionally, include any past surgeries or procedures related to the chief complaint. Medications should never be included in this section.\nPast Medical History: Input any information relating to current or past medical conditions, chronic illnesses, surgeries, hospitalizations, procedures for the patient only. Do not include any medical conditions or symptoms for family. Never include any medications in this section.\nSocial History: Include information about home and environment, living arrangements, education, employment, eating, relationships and family life, activities, and mental health if mentioned.\nFamily History: Include information about pertinent family history which can include hereditary or genetic conditions in the family, as well as any medical conditions or symptoms mentioned for any relatives.\nPhysical Examination: Include the examination findings done by the doctor.\nDiagnosis: Include the relevant diagnosis suggestion only using ICD 10 code nomenclature and descriptions for the visit based only on information present in the conversation. Do not include ICD-10 codes in output. In the case of multiple diagnosis, always separate each diagnosis by a semicolon (';').\nPrescription Medications: Include the medications and dosage instructions (if specified) that are prescribed during this consultation only. In the case of multiple prescription medications, always separate each medication by a semicolon (';').\nCurrent Medications: Include the medications, vitamins, or supplements that the patient is currently taking or has been previously prescribed.\nLaboratory Tests: Include any imaging, diagnostic, or lab tests the patient was advised to do during the visit. In the case of multiple orders, always separate each order by a semicolon (';').\nPlan of Care: Include the detailed plans for addressing the patients condition from the conversation such as follow up care, treatment plans, prognosis, recommendations and patient instructions. Never include any specific medications or lab or diagnostic tests ordered in this section. The plan of care should be a plain free flow text.\n\n### Conversation:\n{}\n\n### Response:'''

  2. Assistant

    To generate SOAP notes from Arabic transcriptions of doctor-patient conversations, you can use the following prompt. This prompt is designed to handle conversations in Arabic, translating them into English, and then extracting the relevant information to create a structured SOAP note in JSON format. It is adaptable for conversations of varying lengths.

    Prompt:

    Below is an instruction that describes a task, paired with an input that provides further context. Provide an accurate response that appropriately completes the specified task. Only use the information provided in the input. Do not infer or assume additional details.
    
    ### Instructions:
    
    1. **Language Detection and Translation:**
       - If the conversation is entirely in English, proceed directly to step 2.
       - If the conversation contains any Arabic text (fully or partially), translate the entire conversation into clear and accurate English. Maintain the integrity of all medical terminologies, drug names, medications, surgeries, and other healthcare-related terms. Ensure no alterations or misinterpretations, particularly for medications and treatments. For example, medical terms like "إيبوبروفين 600" should be translated as "Ibuprofen 600" and not as "Proven 600". Do not include the translated conversation in the final response.
    
    2. **SOAP Note Extraction:**
       - Using the details from the translated (if applicable) conversation, extract the relevant information and generate a SOAP note in English. Structure the information in a JSON format with keys in lowercase. If the conversation does not contain any relevant information for a particular section, leave that section blank or write "Not mentioned." Do not make assumptions.
    
    **SOAP Note Structure:**
    
    - **chief_complaint:** Include the patient's primary reason for the visit, such as signs, symptoms, severity, etc. Do not include patient age or gender under chief complaints. Never leave this section blank.
    
    - **allergy:** Include information about any known allergies. If no allergies are discussed, return "No known allergies." In the case of multiple allergies, separate each allergy by a semicolon (';').
    
    - **history_of_present_illness:** Start with the patient's reason for the visit. Include details of the chief complaint only if discussed in the conversation, covering onset, duration, timing, quality, severity, and any other relevant history related to the complaint. Document any additional complaints, signs, and symptoms mentioned. If the patient denies any symptoms, explicitly include them. If screenings, lab results, or markers are discussed, incorporate them as well. Additionally, include any past surgeries or procedures related to the chief complaint. Medications should never be included in this section.
    
    - **past_medical_history:** Input any information relating to current or past medical conditions, chronic illnesses, surgeries, hospitalizations, or procedures for the patient only. Do not include any medical conditions or symptoms for family. Never include any medications in this section.
    
    - **social_history:** Include information about home and environment, living arrangements, education, employment, eating habits, relationships and family life, activities, and mental health if mentioned.
    
    - **family_history:** Include information about pertinent family history, which can include hereditary or genetic conditions in the family, as well as any medical conditions or symptoms mentioned for any relatives.
    
    - **physical_examination:** Include the examination findings done by the doctor.
    
    - **diagnosis:** Include the relevant diagnosis suggestion only using ICD-10 code nomenclature and descriptions for the visit based only on information present in the conversation. Do not include ICD-10 codes in the output. In the case of multiple diagnoses, separate each diagnosis by a semicolon (';').
    
    - **prescription_medications:** Include the medications and dosage instructions (if specified) that are prescribed during this consultation only. In the case of multiple prescription medications, separate each medication by a semicolon (';').
    
    - **current_medications:** Include the medications, vitamins, or supplements that the patient is currently taking or has been previously prescribed.
    
    - **laboratory_tests:** Include any imaging, diagnostic, or lab tests the patient was advised to do during the visit. In the case of multiple orders, separate each order by a semicolon (';').
    
    - **plan_of_care:** Include the detailed plans for addressing the patient's condition from the conversation, such as follow-up care, treatment plans, prognosis, recommendations, and patient instructions. Never include any specific medications or lab or diagnostic tests ordered in this section. The plan of care should be a plain free-flow text.
    
    ### Conversation:
    {Insert Arabic transcription here}
    
    ### Response:
    

    Usage:

    Replace {Insert Arabic transcription here} with the actual Arabic transcription of the doctor-patient conversation. The model will then process the input according to the instructions, translating the conversation if necessary and extracting the relevant information to generate a structured SOAP note in JSON format.

    Example:

    If the Arabic transcription is:

    مرحبا دكتور عمار، أعاني من ألم في الحلق وارتفاع في درجة الحرارة منذ أسبوع.
    

    The prompt would be:

    Below is an instruction that describes a task, paired with an input that provides further context. Provide an accurate response that appropriately completes the specified task. Only use the information provided in the input. Do not infer or assume additional details.
    
    ### Instructions:
    
    1. **Language Detection and Translation:**
       - If the conversation is entirely in English, proceed directly to step 2.
       - If the conversation contains any Arabic text (fully or partially), translate the entire conversation into clear and accurate English. Maintain the integrity of all medical terminologies, drug names, medications, surgeries, and other healthcare-related terms. Ensure no alterations or misinterpretations, particularly for medications and treatments. For example, medical terms like "إيبوبروفين 600" should be translated as "Ibuprofen 600" and not as "Proven 600". Do not include the translated conversation in the final response.
    
    2. **SOAP Note Extraction:**
       - Using the details from the translated (if applicable) conversation, extract the relevant information and generate a SOAP note in English. Structure the information in a JSON format with keys in lowercase. If the conversation does not contain any relevant information for a particular section, leave that section blank or write "Not mentioned." Do not make assumptions.
    
    **SOAP Note Structure:**
    
    - **chief_complaint:** Include the patient's primary reason for the visit, such as signs, symptoms, severity, etc. Do not include patient age or gender under chief complaints. Never leave this section blank.
    
    - **allergy:** Include information about any known allergies. If no allergies are discussed, return "No known allergies." In the case of multiple allergies, separate each allergy by a semicolon (';').
    
    - **history_of_present_illness:** Start with the patient's reason for the visit. Include details of the chief complaint only if discussed in the conversation, covering onset, duration, timing, quality, severity, and any other relevant history related to the complaint. Document any additional complaints, signs, and symptoms mentioned. If the patient denies any symptoms, explicitly include them. If screenings, lab results, or markers are discussed, incorporate them as well. Additionally, include any past surgeries or procedures related to the chief complaint. Medications should never be included in this section.
    
    - **past_medical_history:** Input any information relating to current or past medical conditions, chronic illnesses, surgeries, hospitalizations, or procedures for the patient only. Do not include any medical conditions or symptoms for family. Never include any medications in this section.
    
    - **social_history:** Include information about home
    

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.