Skip to content
TheChatArchiveThe Chat Archive
Qwenqwen3-235b-a22b-no-thinking· Alibaba (Qwen)Hugging Face LMArena Human Preference 140K

How do you think we should calculate this supplier performance? we want to assign a…

From a Chatbot Arena battleThe same person sent this prompt to two anonymous models at once. Compare it with grok-3-mini-beta’s answer.
  1. User

    How do you think we should calculate this supplier performance? we want to assign a "score" or a ratio, where the supplier that has the most order, should has the most On-time ratio. So for example, it is better to have a supplier that has 10000 orders and 75% on-time ratio rather than a supplier that has 100 order and 95% on-time ratio. Feel free to tweak the numbers that you think are "fair" for supplier and us

  2. Qwen Assistant

    To calculate supplier performance in a balanced way that rewards both high on-time delivery (OTD) and volume, you can use a weighted scoring system that combines:

    1. On-Time Delivery (OTD) Ratio
    2. Order Volume

    This ensures that suppliers with more orders are not unfairly penalized for having slightly lower OTD, but also that small suppliers don’t get overvalued due to limited data.


    ✅ Goal:

    Create a Supplier Performance Score (SPS) such that:

    • A supplier with high volume and decent OTD gets a better score than one with low volume and high OTD.
    • The score is fair, transparent, and customizable.

    🧮 Step-by-step Supplier Performance Score Formula

    Let’s define:

    • OTDiOTD_i = On-Time Delivery ratio of supplier ii (e.g., 75%)
    • NiN_i = Number of orders handled by supplier ii
    • max⁡(N)\max(N) = Maximum number of orders across all suppliers
    • ww = Weighting factor between OTD and volume (default: 0.5)

    🔢 Final Score:

    SPSi=w⋅OTDi+(1−w)⋅Nimax⁡(N)\text{SPS}_i = w \cdot OTD_i + (1 - w) \cdot \frac{N_i}{\max(N)}

    This gives a score between 0 and 1 (or 0–100 if multiplied by 100), where higher is better.


    📊 Example:

    SupplierOrders (Ni)OTD (%)
    A10,00075
    B10095

    Assume w=0.6w = 0.6 (so we value OTD a bit more than volume).

    max⁡(N)=10,000\max(N) = 10,000

    Now compute SPS:

    • Supplier A:

      SPS=0.6⋅75+0.4⋅10,00010,000=45+40=85\text{SPS} = 0.6 \cdot 75 + 0.4 \cdot \frac{10,000}{10,000} = 45 + 40 = 85
    • Supplier B:

      SPS=0.6⋅95+0.4⋅10010,000=57+0.4=57.4\text{SPS} = 0.6 \cdot 95 + 0.4 \cdot \frac{100}{10,000} = 57 + 0.4 = 57.4

    ✅ Supplier A wins the score despite a lower OTD because they handle much larger volume.


    ⚙️ Customization Tips:

    • Adjust the weight ww depending on your business goals:
      • w=0.7w = 0.7 → prioritize OTD more
      • w=0.3w = 0.3 → prioritize volume more
    • You can normalize order volume using log scale if needed: log⁡(1+Ni)log⁡(1+max⁡(N))\frac{\log(1 + N_i)}{\log(1 + \max(N))} This helps avoid extreme dominance by a very large supplier.

    🎯 Alternative Advanced Metric (Bayesian Average):

    If you want a more statistically sound approach, you can use a Bayesian average or shrinkage estimator, which pulls low-volume supplier OTDs toward the overall average.

    But for simplicity and practicality, the weighted score above works well.


    📌 Summary:

    Use this formula:

    Supplier Performance Score=w⋅OTD+(1−w)⋅Nmax⁡(N)\boxed{ \text{Supplier Performance Score} = w \cdot OTD + (1 - w) \cdot \frac{N}{\max(N)} }

    Where:

    • OTDOTD is the % of on-time deliveries
    • NN is the total number of orders
    • ww is a weight (e.g., 0.5 for equal importance, 0.6–0.7 for more OTD emphasis)

    Let me know if you’d like help implementing this in Excel or Python!

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.